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ABSTRACT 


The  following  EDA  paper  summarizes  the  results  of  an  assessment  of  benefits  to 
DoD  resulting  from  the  use  of  three  DoD  Information  Analysis  Centers  (LACs)  by  DoD 
components  and  DoD  contractors.  The  IACs  examined  in  this  report  include  the  Chemical 
Warfare/Biological  Defense  Information  Analysis  Center  (CBIAQ,  the  Tactical  Weapon 
Guidance  and  Control  Information  Analysis  Center  (GACIAC),  and  the  Reliability 
Analysis  Center  (RAC). 

Information  Analysis  Centers  provide  information  to  users  under  two  different 
categories  of  services.  One  category  is  a  core  program,  supported  by  Defense  Logistic 
Agency  funds.  The  second  category  is  special  tasks,  supported  by  tasking  and  funding 
from  requiring  DoD  agencies. 

The  study  found  that  it  was  possible  to  quantify  some  of  the  benefits  reported  by 
LAC  users.  However,  most  users  interviewed  by  the  IDA  team  did  not  conceive  of  their 
information  requests  in  terms  that  lent  themselves  to  quantification.  They  did  not,  for 
example,  consider  the  costs  of  obtaining  similar  information  from  alternative  sources,  nor 
did  they  consider  the  costs  of  obtaining  information  had  they  undertaken  the  information 
search  and  analyses  themselves.  As  a  result,  LAC  users  who  turned  to  the  IAC  for  core 
products  and  services  found  it  especially  difficult  to  quantify  benefits. 

In  several  instances,  EDA  was  able  to  analyze  the  benefits  reported  and  identify  a 
conservative  basis  for  estimating  the  dollar  benefits  of  IAC  information  products  and 
technical  advisory  services.  In  some  cases,  these  estimates  were  based  on  tangible  or 
estimated  savings  compared  to  the  costs  of  using  alternative  sources  of  information.  In 
other  instances,  these  quantified  benefits  were  estimated  based  on  changes  to  organizational 
routines  and  behaviors.  In  still  other  instances,  we  were  able  to  obtain  firm  estimates  from 
users  regarding  improvements  in  their  organizations'  productivity,  labor  utilization,  or 
costs  associated  with  trying  to  obtain  similar  information  relying  on  internal  resources. 

However,  it  was  possible  to  categorize  qualitative  benefits  provided  by  IACs 
as  follows:  verification  and/or  substantiation  of  existing  information;  verification  or 
substantiation  of  information  from  a  neutral,  unbiased  authoritative  source;  enhanced 
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productivity;  promotion  and/or  implementation  of  standards  and  standardization;  enhanced 
communication  among  scientists  and  engineers;  enhanced  competitiveness  within  the 
defense  industrial  base;  and  improved  military  capability. 


LAC  users  who  employed  CBIAC,  GACIAC,  and  RAC  to  perform  additional  tasks 
had  somewhat  better  success  in  either  directly  quantifying  benefits,  or  collecting  data  which 
permitted  IDA  staff  to  quantify  a  lower  bound  for  the  benefit  resulting  from  the  IACs  task. 
Special  tasks  result  in  specific  information  products  or  the  provision  of  specific  technical 
advisory  services.  These  lend  themselves  to  comparisons  and  contrasts  with  other  methods 
of  obtaining  similar  information  or  advice,  the  costs  for  which  can  be  estimated.  Special 
task  users  also  reported  very  substantial  qualitative  benefits,  particularly  in  improvements 
in  military  capability,  military  training,  R&D  planning,  and  R&D  productivity. 
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GLOSSARY 


CBIAC 

Chemical  Warfare/Biological  Defense  Information  Analysis  Center 

CHEM  DEMIL 

Chemical  Demilitarization 

COTR 

Contracting  Officer's  Technical  Representative 

CPIA 

Chemical  Propulsion  Information  Agency 

CRDEC 

Chemical  Research  Development  and  Engineering  Center 

CRSTLAC 

Cold  Regions  Science  and  Technology  Information  Analysis  Center 

CSERIAC 

Crew  Systems  Ergonomics  Information  Analysis  Center 

CTM 

Contract  Technical  Monitor 

CW 

Chemical  Warfare 

DACS 

Data  Analysis  Center  for  Software 

DASIAC 

DoD  Nuclear  Information  Analysis  Center 

DDDR&E 

Deputy  Director  for  Defense  Research  and  Engineering 

DLA 

Defense  Logistics  Agency 

DOD 

Department  of  Defense 

DOE 

Department  of  Energy 

DROLS 

Defense  Research  On-Line  System 

DTIC 

Defense  Technical  Information  Center 

ECP 

Engineering  Change  Plan 

EIS 

Environmental  Impact  Statement 

GACIAC 

Tactical  Weapons  Guidance  and  Control  Information  Analysis  Center 

HEIAC 

Hydraulic  Engineering  Information  Analysis  Center 

HTMIAC 

High  Temperature  Materials  lrformation  Analysis  Center 

IAC 

IDA 

IRIA 

Mac 

MMOAC 

MTIAC 

NTIAC 

OSD 

PCO 

PLASTEC 

PSTLAC 

R&AT 

RAC 

RDT&E 

SMLAC 

STIP 

SURVLAC 

TEPIAC 

USG 


Information  Analysis  Center 

Institute  for  Defense  Analyses 

Infrared  Information  Agency 

Metals  and  Ceramics  Information  Center 

Metal  Matrix  Composites  Information  Analysis  Center 

Manufacturing  Technology  Information  Analysis  Center 

Nondestructive  Testing  Information  Analysis  Center 

Office  of  the  Secretary  of  Defense 

Procuring  Contracting  Officer 

Plastics  Evaluation  Center 

Pavements  and  Soil  Trafficability  Information  Analysis  Center 

Office  of  the  Deputy  Director  for  Defense  Research  and  Engineering, 
Research  and  Advanced  Technology 

Reliability  Analysis  Center 

Research,  Development,  Test,  and  Engineering 

Soil  Mechanics  Information  Analysis  Center 

Scientific  and  Technical  Information  Program 

Survivability/V ulnerability  Information  Analysis  Center 

Thermophysical  and  Electronic  Properties  Information  Analysis  Center 
(now  the  High  Temperature  Materials  Information  Analysis  Center) 

United  States  Government 


EXECUTIVE  SUMMARY 


INTRODUCTION 

The  Department  of  Defense  operates  22  Centers  for  the  Analysis  of  Scientific  and 
Technical  Information  (Information  Analysis  Centers-LACs).1  These  I  AC:  serve  as  /  ;d 
points  within  the  DoD  for  acquiring,  storing,  and  synthesizing  available  wo/’dwide 
scientific  and  technical  information  and/or  data  in  a  clearly  defined,  specialised  fin'd  or 
subject  area  of  interest  to  DoD.  Once  acquired,  this  information  is  then  digested,  analyzed, 
evaluated,  synthesized,  and  may  be  published  in  authoritative,  timely,  standard  reference 
works  and  useful  reports  or  conveyed  in  technical  advisory  services  to  the  requiring  DcD 
activities. 

The  following  report  summarizes  the  results  of  IDA's  review  of  the  benefits  to  DoD 
resulting  from  the  use  of  three  DoD  Information  Analysis  Centers  (IACs)  by  DoD 
components  and  DoD  contractors.  Information  products  and  services  provided  by  the 
Chemical  Warfare/Biological  Defense  Information  Analysis  Center  (CBIAC),  the  Tactical 
Weapon  Guidance  and  Control  Information  Analysis  Center  (GACIAQ,  and  the  Reliability 
Analysis  Center  (RAC)  were  examined  to  identify  and  quantify,  where  possible,  benefits  to 
DoD  and  its  contractors. 

This  phase  of  the  IDA  study  also  examined  the  administration,  management,  and 
oversight  of  the  DoD  IAC  program.  The  results  of  this  program  assessment  are 
summarized  in  a  separate  report 

STUDY  METHOD 

The  basic  approach  taken  by  EDA  in  both  the  pilot  study  and  the  representative  IAC 
sample  study  was  as  follows: 

•  Identify  program  goals  and  objectives  as  articulated  by  DoD  directives,  policy 
statements  by  authoritative  DoD  spokesmen,  and  senior  program  managers. 


1  See  Appendix  A  for  DoD  Regulation  3200.12-R-2,  "Centers  for  the  Analysis  of  Scientific  and 
Technical  Information."  See  Appendix  B  for  a  listing  of  current  DoD  Information  Analysis  Centers. 
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•  Identify  or  develop  appropriate  quantitative  and  qualitative  measures  of  merit  to 
be  used  in  assessing  the  cost,  benefit,  effectiveness,  and  performance  of 
individuals  and  organizations  participating  in  the  management,  oversight, 
operation,  and  evaluation  of  the  DoD  Information  Analysis  Center  Program, 

•  Develop  questionnaires  and  other  instruments  needed  to  collect  data  bearing  on 
the  measures  of  merit  appropriate  to  each  organization  participating  in  the 
management,  oversight,  operation,  or  evaluation  of  DoD  Information  Analysis 
Centers, 

•  Conduct  interviews  and  review  records,  where  appropriate,  in  order  to  collect 
data,  and 

•  Analyze  data  collected  during  the  field  survey  phase  of  the  study. 

A  general  questionnaire  was  prepared  and  was  significantly  tailored  or  modified  to 
elicit  information  regarding  the  specific  responsibilities  of  each  individual  for  IAC 
programming,  budgering,  operations,  management,  oversight,  and  performance  evaluation. 
Each  questionnaire  was  reviewed  with  the  sponsor  and  further  modified  in  order  to  elicit 
additional  information  that  might  be  helpful  in  obtaining  both  direct  and  indirect  evidence  of 
costs  and/or  benefits  of  the  IAC  program  to  DoD. 

During  this  phase  of  our  study,  we  sought  to  examine  the  benefits  to  DoD  from  the 
use  of  LACs  as  different  from  the  Nondestructive  Testing  Information  Analysis  Center 
considered  in  detail  in  our  pilot  study.  Among  the  more  specific  criteria  used  to  screen  the 
remaining  IACs  were  the  following: 

•  Focus  of  IAC  not  in  the  field  of  materials  science 

•  IAC  users  from  the  research  and  engineering  community,  especially  those 
funded  from  budget  category  6.1  through  6.3A  funds 

•  IAC  work  being  performed  substantially  in  subject  areas  subject  to  export 
controls  and/or  national  security  classification 

•  LAC  in  the  initial  contract  period  with  the  Defense  Logistics  Agency 

•  IAC  with  a  Contracting  Officer’s  Technical  Monitor  not  on  the  OSD  staff 

•  IAC  whose  Procuring  Contracting  Officer  was  not  a  DLA  staff  member. 

We  selected  the  Chemical  Warfare/Biological  Defense  Information  Analysis  Center 
(CBIAC),  the  Tactical  Weapons  Guidance  and  Control  Information  Analysis  Center 
(GAC1AC),  and  the  Reliability  Analysis  Center  (RAC)  to  be  included  in  our  examination  of 
benefits  to  users  of  a  representative  sample  of  DoD  IACs. 


IAC  INFORMATION  CATEGORIES 


DoD  LACs  provide  information  products  and  services  to  their  respective  user 
communities  in  two  major  categories:  core  program  information  products  and  services,  and 
special  task  products  and  technical  advisory  services.  During  this  phase  of  our  study,  we 
examined  samples  of  core  program  information  focusing  most  heavily  on  individualized 
responses  to  bibliographic  inquiries,  technical  inquiries,  and  referrals  to  additional  sources 
of  information  prepared  for  identified  persons  during  FY  1988.  We  sought  to  identify  both 
quantitative  and  qualitative  benefits  accruing  to  DoD  as  a  result  of  the  use  of  the  core 
products  and  services. 

We  also  examined  the  results  of  special  studies  and  tasks  provided  by  CBIAC, 
GACIAC,  and  RAC.  While  our  list  of  special  tasks  dated  back  to  1985  in  the  cases  of 
GACIAC  and  RAC  and  1986  in  the  case  of  CBIAC,  most  of  the  information  collected  from 
LAC  users  dealt  with  benefits  identified  from  special  tasks  undertaken  and  completed  in 
1987  and  1988. 

BENEFITS  OF  DOD  IAC  CORE  PROGRAMS 
Quantitative  Benefits 

Although  we  interviewed  more  than  150  users  of  core  information  products 
prepared  by  CBIAC,  GACIAC,  and  RAC,  we  found  relatively  few  instances  in  which 
benefits  could  be  quantified.  Eight  CBIAC  core  program  information  consumers  reported 
that  during  calendar  year  1988  that  they  had  saved  in  excess  of  $565,000.  This  judgment 
was  based  on  the  estimated  costs  of  obtaining  information  equivalent  to  that  provided  by 
CBIAC  by  other  means  (materials  testing)  or  from  other  sources.  One  GACIAC  user 
reported  a  benefit  of  using  GACIAC  to  prepare  a  bibliography  in  terms  of  man-dayc  caved. 
This  user  did  not  translate  the  savings  in  labor  hours  to  savings  in  dollars.  One  RAC  core 
user  reported  saving  approximately  $850  by  relying  on  RAC  to  provide  documents  which 
could  otherwise  be  obtained  but  at  higher  cost  and  considerable  delay. 

The  IDA  study  team  was  able  to  quantify  some  of  the  benefits  reported  by 
examining  estimated  costs  of  obtaining  similar  information  from  alternative  sources.  We 
were  also  able  to  estimate  benefits  by  examining  estimates  of  costs  that  might  have  been 
incurred  had  IAC  information  products  and  services  not  been  available  to  the  requiring  DoD 
activity.  In  no  case,  however,  did  IDA  rely  exclusively  on  estimates  of  cost  savings 
provided  by  LAC  user. 


Qualitative  Benefits 


We  did  find  that  most  core  program  users  could  describe  in  fairly  rigorous  terms  a 
broad  range  of  qualitative  benefits  they  obtained  by  turning  to  DoD  IACs.  These  qualitative 
benefits  can  be  grouped  into  the  following  categories: 

•  Verification  of  information; 

•  Absolute  objectivity, 

•  Enhanced  productivity; 

•  The  ability  to  work  to  standards  (in  some  cases,  the  standards  the  LAC  helped 
to  produce); 

•  Greater  competition; 

•  Enhanced  communication;  and 

•  Improved  military  capability. 

Table  S-l  summarizes  the  number  of  tiroes  an  LAC  user  identified  a  qualitative 
benefit  obtained  from  CBIAC,  GACIAC,  or  RAC.  The  reader  is  reminded  that  several 
users  reported  multiple  qualitative  benefits  from  their  individual  response  information  item. 


Table  S-1.  Qualitative  Benefits  of  Representative  Sample  DoD  IAC 
Individual  Response  Information  Items 


Benefit  Category 

CBIAC 

GACIAC 

RAC 

No  Defined  Qualitative  Benefit 

11 

36 

8 

Verification/Substantiation 

22 

3 

14 

Objectivity  &  Neutral  Competence 

9 

1 

3 

Enhanced  Productivity 

44 

11 

9 

Standards  and  Standardization 

6 

0 

0 

Enhanced  Communication 

4 

11 

0 

Enhanced  Competitiveness 

8 

2 

3 

Enhanced  Military  Capability 

7 

3 

2 

Total  #  of  Tasks  Examined 

75 

50 

33 

At  the  macro  level  of  analysis,  the  core  users  with  whom  we  spoke  were  generally 
able  to  identify  a  qualitative  benefit  from  relying  on  one  of  the  DoD  IACs  included  in  our 
representative  sample.  On  further  analysis,  it  appears  that  the  core  program  at  each  IAC  is 
in  fact  accomplishing  one  of  the  primary  purposes  of  IAC  program  as  a  whole-promoting 
the  exchange  and  dissemination  of  scientific  and  technical  information  in  fields  of  science 
and  technology  in  which  DoD  maintains  a  significant  programmatic  thrust 


BENEFITS  OF  DOD  IAC  SPECIAL  TASKS 
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Our  study  also  sought  to  identify  both  quantitative  and  qualitative  benefits  to  DoD 
accruing  from  the  use  of  CBIAC,  GACIAC,  and  RAC.  We  examined  a  listing  of  special 
tasks  placed  at  each  IAC  for  the  most  recent  contract  fiscal  years.  We  then  selected 
candidate  special  task  users  to  be  interviewed  for  our  study  to  assess  the  benefits  of  DoD 
IACs.  We  commenced  to  interview  identified  users  in  as  many  locations  as  could  be 
visited  within  the  time  and  resource  constraints  of  the  task.  The  results  of  our  interviews 
and  assessment  of  the  information  obtained  through  them  follow. 

Quantitative  Benefits 

The  study  attempted  to  identify  both  quantitative  and  qualitative  benefits  to  DoD 
resulting  from  the  use  of  DoD  IACs.  The  choice  of  DoD  IACs  as  a  source  of  information, 
analysis,  and  technical  assistance  made  by  special  task  users  suggests  an  implicit  judgment 
by  special  task  customers  that  IACs  offer  at  least  benefits  equal  if  not  greater  than  the  cost 
of  special  tasks.  Table  S-2  illustrates  that  in  several  instances,  special  task  users  of 
CBIAC,  GACIAC  and  RAC  were  able  to  either  document  or  provide  information  enabling 
the  EDA  study  team  to  calculate  quantitative  benefits  for  several  special  tasks. 


Tabla  S-2.  Quantitative)  Benefits  From  Selected  DOD  IACS 


IAC 

*  of  Tasks 
with  Bansflt 

Data 

Total  Coai  of 

Taaka 

Quantified 

Vaiue  of 
Beneflta 

Benefit  Calculation 
Method 

#  of  Tasks 
Quantified 
Benefits 

Cost  of  Tasks 
with  Quantified 
Benefits 

CBIAC 

32 

$4,268,000 

$1,407,500 

•  LOWER  LABOR  RATES 
•  DEFERRED  PROCUREMENT 

5 

$431,000 

GACIAC 

14 

$5,285,000 

$5,045,000 

•  LOWER  LA80R  RATES 

•  REDUCTION  IN  FIELD 

TEST  "PME 

•  ACCELERATION  OF  RSO 

5 

$1,642,000 

RAC 

8 

$1,916,000 

>$15,330,000 

•  LOWER  LABOR  RATES 
•COST  AVOIDANCE 

BY  AVOIDING 

OF  AMMO  PLANT 
•  IMPROVED  RELIABILITY  OF 
M1STAR  SYSTEMS 

3 

$1,225,500 
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We  found  that  many  special  task  users  of  CBIAC,  GACIAC,  or  RAC  had  great 
difficulty  in  quantifying  the  benefits  resulting  from  their  use  of  the  LACs.  When  users  were 
able  to  present  their  quantification  of  benefits  or  sufficient  data  to  allow  us  to  quantify  the 
benefits,  we  saw  considerable  benefits.  In  the  case  of  CBIAC,  most  of  the  quantifiable 
benefits  were  the  result  of  lower  labor  rates  or  cost  avoidance  as  a  result  of  a  specific 
special  task.  In  the  case  of  GACIAC,  the  LAC  had  developed  several  analytical  tools  and 
techniques  which  will  result  in  recurring  savings  to  the  user  community.  The  development 
of  a  terrain  model  of  the  Pacific  Missile  Test  Center  and  its  subsequent  use  in  test  mission 
planning,  range  instrumer  tation  modernisation,  and  test  operations  will  result  in  recurring 
savings  estimated  by  the  Navy  at  several  million  $  per  year. 

In  the  case  of  RAC,  three  tasks  resulted  in  benefits  which  would  be  measured 
quantitatively.  RACs  contribution  to  the  Army’s  ammunition  plant  modernization  program 
was  very  dramatic.  The  Army  officials  with  whom  we  spoke  credited  RAC  with 
development  and  implementation  of  the  process  control  technology  at  new  Army 
ammunition  plants  which  obviated  the  need  for  $2.1  billion  in  new  construction.  While  the 
Army  credited  RAC  with  savings  in  excess  of  $200  million,  IDA  partitioned  the  savings 
among  all  contractors  and  Army  organizations  participating  in  the  ammunition  plant 
modernization  program.  RACs  share  of  the  $200  million  plus  benefit  was  calculated  by 
IDA  at  approximately  $9  million.  Similarly,  the  program  manager  for  the  MILSTAR 
program  credited  RAC  with  saving  the  program  $6  to  $10  million  per  year  over  the  life  of 
the  program  once  the  satellites  are  in  production.  IDA  elected  to  credit  RAC  with  a  one¬ 
time  savings  of  $6  million. 

While  it  is  not  possible  to  develop  a  general  benefit-cost  ratio  for  all  IAC  special 
tasks,  we  found  that  where  it  was  possible  to  calculate  both  direct  contract  or  task  costs  for 
special  tasks  on  the  one  hand  and  quantify  benefits  on  the  other,  the  benefit-cost  ratio  for 
the  three  IACs  examined  in  this  portion  of  our  study  was  as  follows: 

CBIAC  3.3  to  1 

GACIAC  3.1  to  1 

RAC  12.5  to  1. 


Qualitative  Benefits 

Although  many  special  task  users  could  not  quantify  the  benefits  of  using  CBIAC, 
GACIAC,  or  RAC,  most  could  identify  discrete  qualitative  benefits  which  in  their  minds 
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equaled  or  exceeded  the  costs  of  their  special  tasks.  Table  S-3  summarizes  the  qualitative 
benefits  reported  to  the  IDA  study  team. 


Table  S-3.  Qualitative  Benefits  of  Selected  IAC  Special  Tasks 


IAC 

QUALITATIVE  benefit 

EXAMPLE 

CBLAC 

IMPROVED  CAPABILITY 

•AIR  BASE  DEFENSE 

•  AIR  BASE  OPERABILITY 

•  ARMY  CW  DETECTORS 

•  TANK  CREW  PROTECTION 

IMPROVED  TRAINING 

•  NAVY  CW  TRAINING 
•  AIR  FORCE  MASK  TRAINING 

IMPROVED  RAD  PLANNING 

•  NAVY  CW/BW  6J2  PROGRAM 
•  ARMY  CHEMICAL  DEMIL  PROGRAM 
•  CHEMICAL  WARFARE  STUDIES 

IMPROVED  TESTING 

•  BIOLOGICAL  DETECTION 
•  SMOKE  AND  OBSCURANTS  PROGRAM 
•  AIR  FORCE  MASK  PROGRAM 

NEUTRAL  COMPETENCE 

•  EDGEWOOO  ME  REVIEWS 
•  BIOLOGICAL  DEFENSE  PROGRAM 
ENVIRONMENTAL  IMPACT  STATEMENT 
PROCESS 

GACIAC 

IMPROVED  CAPABILITY 

•  AEGIS  ECCM/ESM  PROGRAM 
•  STINGER  MOO  EL 

•  E-O  MOOEUNG/COUNTERMEASURES 

IMPROVED  TESTING 

•  AEGIS  TESTING/ASM  TESTING 
•  ARMY  ANTI- AIR  TESTING 
•  ADVANCED  A F  MATERIALS  TESTING 

IMPROVED  RAD  PLANNING 

•  SaM/AAW  SYSTEMS  TESTING 

MATERIALS  FOR  SENSORS 

•  NEW  SENSOR  MATERIALS  FOR  AF 

ACCELERATED  RAD 

MATERIALS  LABORATORY 
•  IMPROVED  ANTI-ARMOR 

TEST PROGRAM 

RAC 

IMPROVED  CAPABILITY 

•NAVAL  AVIONICS 
•AR  FORCE  EW  POO 
•  RELIABILITY  CENTERED 

MAINTENANCE  FOR  MARINE  CORPS 

VEHICLES 

LONG  TERM  SUSTAINABILITY 

•  FAA  TERMINAL  AREA  SURVEILLANCE 

Each  IAC  included  in  this  phase  of  our  study  had  at  least  one  special  task  user  who 
could  identify  a  change  in  the  operation  of  existing  military  forces  which  improved  U.S. 
combat  capability.  We  were  surprised  to  see  R&D-funded  efforts  contributing  directly  to 
improved  operational  capability  with  no  additional  investment  of  procurement  or  O&M 
funds.  CBLAC  and  GACIAC  were  also  credited  by  several  special  task  users  as  playing 
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significant  roles  in  the  improvement  of  military  training.  CBIAC  and  GACIAC  were 
credited  with  improving  R&D,  especially  as  a  result  of  the  sponsorship  of  classified 
meetings.  These  meetings  provide  a  forum  in  which  data  can  be  collected,  analyzed, 
shared,  and  ultimately  reduced  to  proceedings  which  then  become  the  basis  for  further 
study  and  analysis.  CBIAC  and  GACIAC  users  felt  that  such  meetings  were  essential  to 
the  enhanced  flow  of  scientific  and  technical  information  and  the  acceleration  of  R&D 
throughout  the  communities  served  by  these  IACs. 

SUMMARY  AND  CONCLUSIONS 

We  therefore  conclude  this  phase  of  the  IDA  study.  Evaluation  of  the  DoD 
Information  Analysis  Centers  Program,  with  the  finding  that  core  and  special  task  users  of 
CBIAC,  GACIAC,  and  RAC  are  obtaining  a  wide  range  of  benefits  from  the  use  of  the 
LAC.  In  each  IACs  case,  the  number  of  users  able  to  describe  quantitative  benefits  derived 
from  core  use  is  relatively  small  considering  the  total  number  of  tasks  examined;  however, 
the  quantitative  benefits  from  special  task  use  of  the  IACs  are  quite  substantial.  This 
appears  to  result  from  problems  inherent  in  attaching  value  to  information  by  information 
consumers.  Most  do  not  think  in  terms  of  information  acquisition  costs  and  the  costs  of 
obtaining  similar  information  through  alternative  mechanisms. 

We  found  that  the  qualitative  benefits  from  both  core  and  special  task  use  of 
CBIAC,  GACIAC,  and  RAC  are  quite  significant  Each  LAC  has  contributed  to  improved 
operational  capability  of  existing  military  forces;  each  has  contributed  to  improvements  in 
the  training  of  U.S.  military  personnel;  all  have  been  credited  with  improvements  in  R&D 
productivity. 

Having  concluded  that  DoD  is  benefiting  from  the  Information  Analysis  Centers 
Program  in  its  configuration  circa  1987-1989,  our  study  Pimed  to  an  examination  of 
program  administration,  management,  and  oversight.  These  topics  are  addressed  in 
another  IDA  Paper  available  to  U.S.  Government  personnel  and  authorized  contractors, 
entitled  Evaluation  of  DoD  Information  Analysis  Centers  Program:  Representative  Sample 
Study;  I  AC  Program  Administration,  Management,  and  Oversight. 


/ 

/ 

1.  REPORT  BACKGROUND  AND  INTRODUCTION 

A.  HISTORY 

The  Department  of  Defense  operates  22  Centers  for  the  Analysis  of  Scientific  and 
Technical  Information  (Information  Analysis  Centers— IACs).2  These  IACs  serve  as  focal 
points  within  the  DoD  for  acquiring,  storing,  and  synthesizing  available  worldwide 
scientific  and  technical  information  and/or  data  in  a  clearly  defined,  specialized  field  or 
subject  area  of  interest  to  DoD.  Once  acquired,  this  information  is  then  digested,  analyzed, 
evaluated,  synthesized,  and  may  be  published  in  authoritative,  timely,  standard  reference 
works  and  useful  reports  or  conveyed  in  advisory  services  to  the  interested  DoD  elements 
and  DoD  contractors  in  that  specialized  field. 

The  origin  of  the  DoD  program  has  been  traced  to  the  immediate  post-World  War  II 
period  with  the  initial  support  of  information  analysis  centers  located  at  the  Johns  Hopkins 
University  Applied  Physics  Laboratory  and  the  Naval  Research  Laboratory.3  The  program 
grew  substantially  in  the  1960s  and  1970s  in  terms  of  the  number  of  centers,  and  the 
number  of  disciplines  included  in  the  Information  Analysis  Center  Program  as  well  as  the 
level  of  financial  support  given  to  these  centers  by  the  military  departments.  The  program 
experienced  considerable  growth  during  the  1980s  as  DoD  recognized  increasing 
requirements  to  take  advantage  of  the  growing  accumulation  of  scientific  and  technical 
information  in  fields  of  science  and  technology  of  special  interest  Table  1-1  summarizes 
the  development  of  DoD  IACs. 


2  See  Appendix  A  for  DoD  Regulation  3200.12-R-2,  "Centers  for  the  Analysis  of  Scientific  and 
Technical  Information."  See  Appendix  B  for  a  listing  of  current  DoD  Information  Analysis  Centers. 

3  See  Defense  Technical  Information  Center,  Information  Analysis  Centers  in  ihe  Department  of  Defense 
(Alexandria,  VA:  Defense  Logistics  Agency,  DTIC/TR- 87/17,  1987),  pp.  13-17,  for  a  brief  history  of 
the  DoD  Information  Analysis  Center  program.  Cited  as  DTIC/TR-87/17  below. 
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Table  1-1.  Growth  of  DoD  IAC  Program 


IAC 

(Current  Name) 

Initial 

Year 

Area  of  Focus  & 
Technical  Monitor  Agency 

Current 

Operator 

Chemical  Propulsion  Information 
Agency  (CPIA) 

1946 

Chemical  Propulsion.  Especially 
Rocket  Propulsion 
(NAVSEA) 

DLA 

Contractor 

Infrared  Information  Agency 
(IRIA) 

1951 

Infrared  Sensors,  Materials  and 
Sensors 
(NRL) 

DLA 

Contractor 

Metals  and  Ceramics  Information 
Agency  (MCIC) 

1955 

Titanium  and  Other  Aerospace 
Materials  and  Structures 
(DDDR&E/R&AT) 

DLA 

Contractor 

Cold  Regions  Science  and 
Technology  Information  Analy¬ 
sis  Center  (CRSTIAC) 

1961 

Effects  o f  Cold  Temperatures 
on  Military  Technology  and 

Ope  rations 

(Army  Corps  of  Engineers) 

Army  Corps 
of  Engineers 
In-House 

DoD  Nuclear  Information  Analy¬ 
sis  Center  (DASIAC) 

1961 

Nuclear  Weapon  Effects 
(DNA) 

DNA 

Contractor 

High  Temperature  Materials 
Information  Analysis  Center 
(HTMIAC) 

1960 

Thermophysical  Properties  of 
Materials  with  Special  Focus 
on  Laser  Effects 
(ONT) 

DLA 

Contractor 

Plastics  Technical  Evaluation 
Center  (PLASTEC) 

1960 

Plastics,  Adhesives,  and 
Organic-Matrix  Composites 
(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 
In-House 

Nondestructive  Testing 
Information  Analysis  Center 
(NTIAC) 

1961 

Nondestructive  Evaluation 
and  Testing  of  Materials, 
Structures,  and  Systems 
(DDDR&E/R&AT) 

DLA 

Contractor 

Concrete  Technology  Informa¬ 
tion  Analysis  Center  (CTIAC) 

1965 

Concrete  and  Other  Construc¬ 
tion  Materials 

(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 
In-House 

Hydraulic  Engineering  Informa¬ 
tion  Analysis  Confer  (HEIAC) 

1966 

Hydraulic  Engineering 
(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 

In  House 

Pavements  and  Soil  Traffic- 
ability  Information  Analysis 
Center  (PSTIAC) 

1966 

Favements,  Vehicle  Mobility 
and  Terrain  Analysis 
(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 
In-House 

Soil  Mechanics  Information  and 
Analysis  Center  (SMIAC) 

1966 

Soil  Mechanics,  Geophysics 
and  Engineering  Geology 
(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 
In-House 

Coastal  Engineering  information 
Analysis  Center  (CEIAC) 

1963 

Coastai  Works  Engineering 
Structures  &  Technology 
(Army  Corps  of  Engineers) 

Army  Corps  of 
Engineers 
In-House 

Tactical  Technology  Center* 
(TACTEC) 

1971 

Tactical  Warfare  and 
Counterinsurgency 
(DARPA) 

DARPA 

Contractor 

(continued) 


Thia  IAC  is  not  part  of  the  official  DoD  IAC  program  administered  by  the  Dsfsnsa  Logistics  Agency  but  is 
counted  in  the  total  of  22  DoD  Information  Analysis  Centers. 


Table  1-1  (continued) 


IAC 

(Current  Name) 

Initial 

Year 

Area  of  Focus  & 
Technical  Monitor  Agency 

Current 

Operator 

Reliability  Analysis  Center 
(RAC) 

1972 

Electronic  Materials  and 
Component  Reliability 
(AFRADC) 

Air  Force 
Contractor 

Data  &  Analysis  Center 
for  Software  (DACS) 

1976 

Software  Development 
and  Experience  Data 
(AFRADC) 

Air  Force 
Contractor 

Tactical  Weapon  Guidance 
and  Control  Information  Analysis 
Center  (GACIAC) 

1977 

Tactical  Weapons  Guidance 
Systems,  Control  Systems 
Sensors 
(USAMICOM) 

DLA 

Contractor 

Metal  Matrix  Composites  Infor¬ 
mation  Analysis  Center 
(MMC1AC) 

1979 

Metal  Matrix  Composite 
Materials  for  Vehicles  and 
Aerospace  Applications 
(DDDR&E/RSAT) 

DLA 

Contractor 

Manufacturing  Technology 
Information  Analysis  Center 
(MTIAC) 

1984 

Manufacturing  Systems 
and  Technology 
(DASD/PR) 

DLA 

Contractor 

Survivability/Vuinerability 
Information  Analysis  Center 
(SURVIAC) 

1984 

Aircraft  and  Other  Vehicle 
Survivability,  Vulnerability 
and  Susceptibility 
(AFWRDC) 

DLA 

Contractor 

Chemical  Warfare/Biological 
Defense  Information  Analysis 
Center  (CBIAC) 

1986 

Chemical  Warfare  and 
Biological  Defense 
Science  &  Technology 
(USACRDEC) 

DLA 

Contractor 

Crew  Systems  Ergonomics 
Information  Analysis  Center 
(CSERIAC) 

1988 

Man-Machine  hrteraction 
Including  Human  Factors 
Design  Considerations 
(AFWRDC/ AAMRL) 

DLA 

Contractor 

During  this  period,  several  Centers  were  disestablished  or  combined  with  other 
existing  Centers  as  their  use  declined  or  DoD  technology  thrusts  shifted.  Among  the 
Centers  disestablished  or  combined  were  the  Thermophysical  Properties  Information 
Analysis  Center,  Shock  and  Vibration  Information  Analysis  Center,  and  Machinabiliry 
Information  Center. 

In  1971,  contract  administration  and  funding  responsibilities  for  eight  Information 
Analysis  Centers  were  shifted  from  the  military  departments  to  the  Defense  Supply 
Agency.4  In  addition,  policy  formulation  and  oversight  for  the  entire  DoD  Information 
Analysis  Center  Program  were  vested  in  the  Office  of  the  Director  of  Defense  Research  and 
Engineering.  Each  Center  established  since  1971  has  been  created  following  a  period  of 


4  See  Memorandum  from  DDR&E,  John  S.  Foster  to  Director,  Defense  Supply  Agency.  "Department 
of  Defense  Contractor  Operated  Information  Analysis  Centers,"  7  April  1971. 
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extensive  study  and  analysis  of  the  requirements  for  such  centers.  Among  the  issues 
considered  prior  to  the  establishment  of  such  centers  was  the  need  for  information  analysis, 
the  requirement  of  the  three  services  for  generic  as  opposed  to  service-specific  support,  and 
the  willingness  of  the  R&D  community  to  provide  financial  and  technical  support  to  the 
Centers,  if  established. 

B.  IDA  TASKING 

1 .  Scope  of  Work 

In  1986,  IDA  was  asked  by  the  Office  of  the  Director  for  Defense  Research  and 
Engineering  for  Research  and  Advanced  Technology  to  undertake  a  study  of  DoD 
Information  Analysis  Centers.  The  study  had  three  objectives: 

•  Identify  and  quantify  if  feasible  the  benefits  to  DoD  of  operation  of  DoD 
Information  Analysis  Centers; 

•  Document  identified  benefits  in  a  manner  suitable  for  program  and  budget 
justification;  and 

•  Identify  strengths  and  weaknesses  in  LAC  program  operation  and  management, 
and  make  recommendations  for  changes  to  increase  the  benefits  of  the  DoD 
LAC  program  to  DoD. 

The  intent  of  the  IDA  task  was  to  conduct  a  measured,  thorough  review  of  the  DoD 
Information  Analysis  Center  Program.  During  preliminary  discussions  with  the  Office  of 
the  Deputy  Under  Secretary  of  Defense  for  Research  and  Advanced  Technology,  the  initial 
purpose  of  the  review  was  viewed  as  an  examination  of  the  desirability  of  the  DoD 
Information  Analysis  Center  Program  for  tne  DoD  R&D  program.  This  was  to  be 
accomplished  by 

•  Assessing  the  collective  and  individual  IAC  contributions  to  the  DoD  research, 
development,  engineering,  and  test  program; 

•  Identifying  those  LACs  that  were  performing  well; 

•  Identifying  those  IACs  which  were  performing  on  the  margin;  and 

•  Identifying  those  IACs  which  had  outlived  their  programmatic  utility. 

As  discussions  with  R&AT  continued,  it  became  clear  to  both  EDA  and  R&AT  that 
the  EDA  study  could  not  simply  jump  off  with  a  program  evaluation.  The  study  would  first 
have  to  develop  a  methodology  which  would  give  all  participants  in  the  program-'  from  the 
IACs,  to  the  DoD  sponsors  of  L\Cs,  to  the  IAC  Program  Office  and  its  management  within 


the  Defense  Technical  Information  Center,  and  Headquarters,  Defense  Logistics  Agency- 
confidence  in  the  judgments  reached  by  both  IDA  and  R&AT.  In  addition,  the  study  would 
have  to  provide  quantitative  information  for  presentation  to  Congress  in  support  of 
increased  funding  for  the  DoD  Information  Analysis  Center  Program  if  increases  were 
found  to  be  warranted. 

Thus,  the  statement  of  work  prepared  by  EDA  and  approved  by  R&AT  contained 
several  steps  in  the  study.  In  addition,  R&AT,  DTIC,  and  IDA  agreed  that  some  son  of 
preliminary  assessment  of  the  program  based  on  a  sample  of  IACs  would  be  helpful  to  the 
ongoing  resource  allocation  process.  In  addition,  IDA  and  R&AT  expected  close 
coordination  between  the  IDA  study  and  an  ongoing  effort  within  DTIC  which  sought  to 
assess  the  impact  of  the  LAC  program  on  DTIC  operations  and  effectiveness. 

As  a  result  of  these  discussions,  IDA  was  given  a  task  order  containing  four 
subtasks: 

Subtask  A:  Work  plan; 

Subtask  B:  Pilot  Study  intended  to  sharpen  the  methodology  to  be  used  in  the 
overarching  study; 

Subtask  C:  Representative  Sample  as  input  for  resource  allocation  discussions 
forFY  1989;  and 

Subtask  D:  Complete  study  of  12  DTIC-administered  IACs. 

In  addition  to  the  subtasks  above,  the  Fiscal  Year  1989  task  order  added  an 
additional  Subtask  E  requiring  IDA  to  examine  alternative  mechanisms  to  fund  core  IAC 
programs. 

2.  PILOT  STLDY 

The  second  phase  of  the  IAC  Program  Evaluation  study  was  a  pilot  study  of  a 
single  IAC  selected  jointly  by  the  sponsor  and  IDA  staff.  The  pilot  study  developed  a 
general  methodology  and  identified  information  requirements  on  which  further  assessments 
of  additional  IACs  were  to  be  built. 

Among  the  issues  examined  during  the  course  of  the  pilot  IAC  study  were  the 
following: 

•  How  does  DoD  policy  assist  or  impact  the  IACs  DoD  technical  monitor’s 
options  for  using  and  supporting  the  IAC  within  his  program? 


•  How  does  the  DoD  technical  monitor  incorporate  the  IAC  into  his  R&D 
program? 

•  How  does  the  DoD  technical  monitor  provide  guidance  to  the  IAC  and  the  DoD 
user  community? 

•  How  does  the  DoD  technical  monitor  determine  and  structure  the  funding 
support  for  the  IAC,  including  but  not  limited  to  the  allocation  of  funding 
sources  among  core  and  other  IAC  services? 

•  How  does  the  technical  monitor  track  and  evabiate  the  performance  of  the  IAC? 

•  Which  products  and  services  of  the  IAC  are  of  direct  benefit  to  the  DoD 
technical  monitor,  how  are  these  products  and  services  used;  how  are  they 
"valued"  by  the  DoD  technical  monitor? 

•  How  effectively  are  the  individual  IACs  administered  and  managed  by  the 
Defense  Logistics  Agency  and  its  field  activities? 

•  How  do  the  Defense  Technical  Information  Center  and  the  Defense  Electronics 
Supply  Center  support  the  DoD  Information  Analysis  Center  Program? 

In  addition  to  examining  the  IACs  from  the  perspective  of  the  DoD  technical 
monitor,  the  pilot  study  examined  the  IAC  from  its  own  perspective.  Among  the  questions 
explored  were  the  following: 

•  What  is  the  IAC  role  in  mission/program  oriented  research? 

•  What  changes  to  that  role  might  be  made? 

•  How  does  the  source  and  method  of  funding  the  IAC  influence  the  focus  of  its 
effort,  allocation  of  its  resources,  and  nature  of  its  products  and  services? 

•  What  is  the  known  utilization  of  IAC  products  and  services? 

•  What  changes  would  increase  the  use  of  IAC  products  and  services? 

•  What  is  the  impact  of  the  DoD  accounting  system  and  other  DoD  management 
systems  on  the  ability  of  the  IAC  to  perform  its  mission? 

•  What  formal  and  informal  mechanisms  are  used  by  the  IAC  to  assess  the 
degree  to  which  its  products  and  services  are  meeting  the  scientific  and 
technical  information  requirements  of  its  user  community? 

Finally,  the  pilot  study  developed  methods  of  data  collection  and  analysis  needed  to 
evaluate  the  effectiveness  of  the  IAC  from  the  perspective  of  the  DoD  and  DoD-contractor 
user  community.  Among  the  questions  explored  were  the  following: 

•  How  satisfied  with  IAC  products  and  services  are  DoD  and  military  department 
program  managers? 
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•  How  might  the  LAC  better  meet  the  needs  of  DoD  and  military  department 
program  managers? 

•  What  IAC  products  and  services  might  DoD  and  military  department  program 
managers  forego  in  order  to  have  their  program  needs  better  met? 

•  How  satisfied  with  IAC  products  and  services  are  DoD  contractors? 

•  How  might  the  IAC  better  meet  the  needs  of  DoD  contractors? 

•  What  steps  might  the  IAC  take  to  improve  its  responsiveness  to  changing  DoD 
contractor  needs  and  requirements? 

The  pilot  study  was  completed  in  draft  in  the  spring,  1988,  and  circulated  within 
OSD  for  comment.5  In  addition,  the  pilot  study  was  widely  briefed  to  various  interested 
components  of  the  IAC  community  including  the  Director  of  the  Defense  Technical 
Information  Center  and  his  IAC  Executive  Council;  the  Director  of  Technical  Services, 
Defense  Logistics  Agency;  the  annual  IAC  Business  Meeting;  and  the  Commander  of  the 
Defense  Electronics  Supply  Center. 

In  July,  1988,  the  pilot  study  was  presented  to  Dr.  George  Millbum,  the  Deputy 
Director  for  Defense  Research  and  Engineering  for  Research  and  Advanced  Technology 
and  senior  members  of  his  staff.  As  a  result  of  this  briefing,  it  was  determined  that  IDA 
should  proceed  with  the  selection  of  a  representative  sample  of  Information  Analysis 
Centers  funded  and  administered  by  the  Defense  Logistics  Agency  and  continue  its  efforts 
to  develop  and  apply  a  method  to  arrive  at  a  benefit-cost  ratio  for  each  DoD  IAC  and  the 
IAC  program  as  a  whole.  IDA  was  further  directed  to  make  observations  on  the 
administration,  management,  and  oversight  of  the  program  and  to  identify  alternatives  that 
might  improve  the  efficiency  and  effectiveness  of  the  IAC  program  in  support  of  R&AT 
research  and  engineering  efforts.  Finally,  IDA  was  directed  to  evaluate  alternatives  based 
on  the  pilot  study  and  the  representative  sample  and  include  preliminary  recommendations 
for  program  reorientation  in  the  report  on  the  representative  sample  of  DoD  IACs. 

3 .  Representative  Sample 

A  set  of  "representative"  IACs  was  selected  in  consultation  with  the  sponsor  during 
July,  1988.  While  the  specific  IACs  selected  will  be  described  in  greater  detail  below,  the 
selection  process  was  guided  by  several  important  considerations  related  to  the  revised 

5  Edwin  S.  Townsley  and  Forrest  R.  Frank.  Evaluation  of  DoD  Information  Analysis  Centers:  Pilot 
Study  (Alexandria,  VA:  Institute  for  Defense  Analyses,  Memorandum  Report  M-U3, 1989). 
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direction  provided  by  IDA  by  Dr.  Millburn  and  his  senior  staff.  Two  somewhat  different 
but  related  purposes  were  to  be  served  by  the  examination  of  a  representative  sample  of 
DoD  IACs: 

•  Continue  efforts  to  establish  individual  and  aggregate  LAC  benefit-cost  ratios; 
and 

•  Compare  and  contrast  the  administration,  management,  and  oversight  of  DLA- 
sponsored  lACs  with  other  lACs  sponsored  by  other  DoD  components  to 
determine  if  any  differences  among  their  administrative  and  management 
practices  had  significant  impact  on  the  ability  of  IACs  to  meet  the  goals  and 
objectives  of  the  DoD  research  and  engineering  program. 

On  the  basis  of  the  pilot  study,  several  factors  were  identified  that  might  have  some 
bearing  on  the  development  of  a  benefit-cost  ratio  for  a  DoD  IAC.  We  therefore  sought  out 
IACs  to  be  included  in  our  representative  sample  that  were  substantially  different  in  certain 
respects  from  Nondestructive  Testing  Information  Analysis  Center  (NTIAC)  to  see 
whether  or  not  those  differences  might  have  some  bearing  on  the  ability  to  identify  and  then 
quantify  benefits  and  costs  to  the  DoD  research  and  engineering  program  arising  from  an 
IAC  or  the  LAC  program  as  a  whole. 

Our  review  of  the  NTIAC  users  disclosed  a  very  large  customer  base  outside  the 
DoD  research  and  development  community.  We  therefore  sought  out  IACs  which  had  a 
very  strong  RdLD  user  base,  with  a  considerable  number  of  special  tasks  funded  out  of 
appropriation  category  >5.1  through  6.3A  funds. 

The  technology  area  included  in  the  cognizance  of  NTIAC  is  predominantly 
unclassified.  We  sought  to  include  IACs  in  our  representative  sample  that  did  a  significant 
portion  of  their  core  and  special  task  work  in  classified  or  export  controlled  areas  of 
information. 

NTIAC  has  a  relatively  long  institutional  history,  having  originally  been  established 
as  a  government-operated  IAC  within  the  Army  Materiel  Command  and  housed  at 
Watertown  /Arsenal.  We  therefore  sought  to  include  in  our  pilot  study  a  relatively  young 
IAC. 

The  pilot  IAC  evaluation  study  of  NTIAC  also  identified  several  institutional  factors 
which  might  have  some  bearing  on  the  identification  and  quantification  of  benefits  on  the 
one  hand,  or  die  operation  of  the  IAC  from  the  perspective  of  the  users  on  the  other.  Thus, 
we  sought  to  include  in  cur  representative  sample  at  least  one  IAC  which  was  independent 
of  Defense  Logistics  Agency  sponsorship  in  order  to  understand  the  range  of  impacts  DLA 


sponsorship  might  have  for  the  operation,  management,  and  oversight  of  the  IAC  and  its 
ability  to  meet  the  requirements  of  its  user  community. 

This  report  examines  the  benefits  provided  by  three  DoD  Information  Analysis 
Centers-the  Chemical  Warfare/Biological  Defense  Information  Analysis  Center,  the 
Tactical  Weapon  Guidance  and  Control  Information  Analysis  Center,  and  the  Reliability 
Analysis  Center—to  DoD.  In  the  following  chapters,  the  IAC  program  goals,  <  bjectives, 
and  operations  will  be  summarized,  the  study  methodology  reviewed,  and  the  benefits  to 
DoD  identified  by  in-depth  review  of  IAC  activities  reported. 

A  second  report  available  to  U.S.  Government  personnel  and  other  eligible  readers 
describes  the  operation  of  the  IAC  program  in  greater  detail,  summarizes  IAC  program 
administration,  management,  and  oversight  strengths  and  weaknesses  identified  during  this 
phase  of  IDA's  study,  and  sets  forth  recommendations  for  changes  in  program  operations 
to  address  weaknesses  identified. 

C.  SUMMARY 

In  this  chapter,  the  reader  has  been  introduced  to  the  history  of  the  DoD  IAC 
Program  and  the  IDA  task,  "Evaluation  of  DoD  Information  Analysis  Centers  Program." 
In  the  balance  of  this  report,  the  reader  will  be  further  acquainted  with  the  DoD  IAC 
program,  the  selection  of  three  additional  IACs  for  further  detailed  review,  and  the  benefits 
provided  resulting  from  the  use  of  CBIAC,  GACIAC,  and  RAC  by  DoD  components, 
other  U.S.  Government  agencies,  and  DoD  contractors. 
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2.  INFORMATION  ANALYSIS  CENTERS 


A.  IAC  FUNCTIONS 

DoD  Regulation  3200.12-R-2,  "Centers  for  Analysis  of  Scientific  and  Technical 
Information  Regulation,"6  defines  a  DoD  Information  Analysis  Center  as  follows: 

A  formal  organization  with  a  primary  mission  to  acquire,  digest,  analyze, 
evaluate,  synthesize,  store,  publish,  and  provide  advisory  and  other  user 
services  concerning  available  worldwide  scientific  and  technical  information 
and  engineering  data  in  a  clearly  defined,  specialized  field  or  subject  area  of 
significant  DoD  interest  or  concern.  Information  Analysis  Centers  (IACs) 
are  distinguished  from  technical  information  centers  and  libraries  whose 
functions  are  primarily  concerned  with  providing  reference  or  access  to 
documents  themselves  rather  than  the  information  contained  in  the 
document.7 

In  order  to  perform  these  functions,  IACs  are  required  by  policy  and  by  contract  to 
have  certain  capabilities  and  additional  associations  with  other  entities  in  order  to  fulfill  their 
information  collection  and  analysis  functions.  The  basic  Defense  Logistic  Agency  contract 
for  an  IaC  specifies  the  following: 

An  information  analysis  center  has  the  capability  to  prepare  authoritative  technical 
reference  works  (i.e.,  handbooks,  data  books,  state-of-the-art  reports^,  etc.),  perform 
special  tasks  or  studies,  provide  analytical  support  to  its  user  community,  and  provide 
authoritative  responses  to  user  inquiries.  This  Center  must  have  immediate  access  (on  a 
part-time  or  full-time,  as-needed  basis)  to  scientific  and  engineering  expertise  (available 
either  in-house  or  under  contract)  in  the  range  of  subjects  and  disciplines  within  the 
Center's  scope  of  work.8  While  an  IAC  contains  elements  of  a  library,  it  is  intended  to 
provide  substantive,  analytical  services  which  go  beyond  functions  usually  performed  by 


6  See  Appendix  A. 

7  Office  of  the  Under  Secretary  of  Defense  for  Research  and  Engineering,  Washington,  DC,  January, 

1985,  p.  1-1. 

8  See  "Statements  of  Work”  for  the  following  Information  Analysis  Centers:  Data  and  Analysis  Center 
for  Software  (DACS),  Paragraph  3.2.6;  Tactical  Weapon  Guidance  and  Control  Information  Analysis 
Center,  Paragraph  9.9;  Metals  and  Ceramics  Information  Center  (MCIC),  Paragraph  8.1;  Metal  Matrix 
Composite  Information  Analysis  Center,  Paragraph  8.9;  and  Reliability  Analysis  Center  (RAC), 

Paragraph  3.3.9. 
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libraries  on  a  regular  basis.9  For  example,  libraries  acquire,  store,  and  catalog  information. 
Libraries  also  lend  materials  to  their  users.  Some  libraries  add  a  current  awareness 
program,  frequently  consisting  of  regular  or  periodic  announcements  of  current 
acquisitions. 

An  LAC,  on  the  other  hand,  typically  undertakes  far  broader  activities  subsuming 
many  of  those  performed  by  a  library.  In  addition  to  acquiring,  cataloging,  indexing,  and 
storing  scientific  and  technical  information  in  its  field  in  documentary  form,  an  IAC 
frequently  seeks  out  non-documentary  forms  of  information.  Several  DoD  IACs  acquire 
films,  experiment  records,  and  raw  experiment  data  in  the  form  of  data  tapes,  research 
notes,  and  preliminary  analyses  of  data.  Other  IACs  also  design,  build,  consolidate, 
maintain,  and  disseminate  data  bases.  These  are  functions  which  are  not  usually  associated 
with  a  library,  which  by  DoD  regulation  is  only  concerned  with  the  collection,  storage,  and 
retrieval  of  documents  or  other  sources  of  information,  not  the  information  contained 
therein.10 

DoD  IACs  also  prepare  abstracts  of  information  collected.  These  abstracts  are 
placed  in  data  bases  accessible  to  DoD  and  its  contractor  community  through  electronic, 
telephonic,  written,  or  personal  inquiry.  In  addition,  several  DLA/DTIC  sponsored  data 
bases  are  installed  in  whole  or  in  part  on  the  DTIC  mainframe  computers  and  can  be 
accessed  through  the  Defense  Technical  Information  Center  Defense  Research  On-Line 
System  (DROLS).  DoD  IACs  are  barred  by  DoD  regulation  from  secondary  distribution  of 


9  The  Committee  on  Scientific  and  Technical  Information  suggested  the  following  definition: 

An  Information  Center  is  a  formally  structured  organizational  unit  specifically  (but  not 
necessarily  exclusively)  established  for  the  purpose  of  acquiring,  selecting,  storing,  retrieving, 
evaluating,  analyzing,  and  synthesizing  a  body  of  information  in  a  clearly  defined  specialized 

field  or  pertaining  to  a  specified  mission  with  the  intent  of  compiling,  digesting,  repackaging,  Q 

or  otherwise  organizing  and  presenting  pertinent  information  in  a  form  most  authoritative, 

timely,  and  useful  to  a  society  of  peers  and  management.  j 

In  1979,  Carroll  and  Maskewitz  have  suggested  the  following  description  of  an  Information  Analysis  i 

Center 

...staffed  mainly  with  scientists  and  engineers,  who  first  index  and  then  compile,  analyze, 

evaluate,  condense,  extrapolate,  and/or  synthesize  information  in  a  given  area  as  integral  steps  ^ 

in  a  comprehensive  information  acquisition,  storage,  retrieval,  and  dissemination  process  for  j 

the  benefit  of  the  scientific  community  to  which  they  belong, 
quoted  in  DTIC/TR-87/17,  op.  cit.,  p.  4. 

10  See  DTICfTR-87/17  op.  cit.,  for  description  of  acquisition  activities  of  various  DOD  IACs;  see 
especially  description  of  acquisition  efforts  by  the  Survivability /Lethality  Information  Analysis  Center 

(SURVTAC),  the  High  Temperature  Materials  Information  Analysis  Center  (HTMIAC),  and  the  DoD  <S> 

Nuclear  Information  Analysis  Center  (DASIAQ  regarding  the  acquisition  of  nondocumentary  forms  of 
scientific  and  technical  information. 
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reports  generated  by  others;  they  are  permitted  to  publish  and  to  disseminate  their  own 
work.  Storage  of  information  at  IACs  is  oriented  to  meeting  the  needs  of  IAC  staff,  not  the 
general  user  community. 

DoD  IACs  maintain  current  awareness  surveillance  of  their  fields  of  expertise. 
Each  IAC  carries  out  this  function  in  its  own  way. 

A  crucial  difference  between  an  IAC  and  a  library  is  the  quality  of  information 
provided  to  users.  Libraries  provide  users  all  information  that  is  available  and  that  falls 
within  the  domain  of  the  request.  IACs,  on  the  other  hand,  provide  information  that  has 
been  substantively  evaluated,  digested,  and  judged  against  the  standards  of  the  field  on  the 
one  hand,  and  the  needs  or  requirements  of  the  requester  on  the  other. 

Another  important  difference  between  an  Information  Analysis  Center  and  a  library 
is  in  the  provision  of  technical  analysis  services.  The  DoD  IACs  have  been  established  to 
provide  a  center  of  expertise  which  can  be  tapped  by  DoD  components,  the  military 
departments,  and  the  DoD  contractor  base  to  provide  answers  to  technical  questions  within 
a  given  field.  As  will  be  documented  in  greater  detail  below  with  examples  from  several 
IACs,  technical  analysis  services  can  range  from  providing  a  simple  referral  to  an  expert  in 
the  field,  to  the  preparation  of  a  short  technical  memorandum,  to  the  conduct  of  a  large, 
technical  study.  Figure  2-1  summarizes  the  differences  between  an  information  analysis 
center  and  a  library. 

The  basic  functions  of  an  IAC  remain  fixed  in  contract  even  though  the 
characteristics  of  the  disciplines  included  in  a  DoD  Information  Analysis  Center  may  cause 
minor  variations  in  the  specific  products  and  services  to  be  provided  by  a  DoD  Information 
Analysis  Center.  Each  IAC  contract  administered  by  the  Defense  Logistics  Agency  (DLA) 
provides  for  two  types  of  products  and  services.  Core  products  and  services  are  provided 
by  the  IAC  in  exchange  for  financial  support  by  DLA.  Special  studies  and  tasks  are 
established  in  principle  by  the  basic  DLA  contract,  but  are  specifically  ordered  and  paid  for 
by  a  sponsoring  military  department,  DoD  agency,  military  activity,  or  other  federal 
government  agency.  Each  of  these  is  described  below. 
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Figure  2-1.  Comparisons  of  Information  Analysis  Centers  and  Libraries 
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B .  CORE  PRODUCTS  AND  SERVICES 

In  the  case  of  the  DoD  IACs  funded  in  part  by  DLA,  the  core  activities  consist  of 
the  basic  LAC  products  and  services  which  establish  and  sustain  the  center  of  excellence. 
Examples  of  core  products  and  services  include  the  following  classes  of  IAC  activities: 

•  Maintenance  of  an  information  support  system  including  but  not  limited  to 
acquisition,  cataloging,  abstracting,  and  indexing  documents  and  other  forms 
of  technical  information;  maintenance  of  bibliographic  data  files,  inventories  of 
the  relevant  technologies  used  within  the  technical  community;  development 
and  maintenance  of  existing  information  retrieval  and  storage  capabilities/ 
technologies; 

•  Preparation  of  bibliographies; 

•  Critical  analysis  and  evaluation  of  each  additional  information  item  added  to  the 
data  base  to  assess  its  significance  and  impact  on  the  field; 

•  Preparation  of  critical  reviews  and  technology  assessments; 

•  Preparation  of  authoritative  technical  reference  works  as  specified  in  the 
contract  which  may  include  but  are  not  necessarily  limited  to  handbooks,  data 
books,  state-of-the-art  reports,  and  software  models;  and 

•  Preparation  of  current  awareness  materials  including  but  not  necessarily  limited 
to  newsletters,  announcements  of  publications,  R&D  events,  conferences,  or 
other  information  needed  to  keep  a  community  aware  of  the  most  current 
developments  within  its  field  of  expertise. 

These  functions  and  the  products  and  services  resulting  from  their  performance  are 
intended  to  perform  at  least  three  distinct  functions  for  DoD: 

1 .  Maintain  and  expand  a  knowledge  base  in  an  area,  discipline,  or  technology  of 
interest  to  DoD; 

2.  Develop  and  sustain  a  center  of  excellence  which  can  be  made  available  to  DoD 
components,  military  departments,  and  DoD  contractors  on  short  notice  to 
address  technical  questions  in  a  low  cost,  time-sensitive  manner, 

3.  Assist  DoD  research  and  development  program  managers  in  identifying  and 
assessing  areas  of  technology  in  need  of  further  effort  by  DoD  in  order  to  meet 
its  military  operational,  maintenance,  reliability,  or  logistical  requirements. 

The  core  task  component  of  a  DoD  IAC  contract  is  usually  funded  by  the  Defense 
Logistics  Agency  through  the  Defense  Technical  Information  Center.  In  the  following 
chapters  we  will  report  on  three  IACs  whose  core  program  is  funded  by  DLA;  a  fourth  IAC 
is  supported  by  funds  provided  by  another  DoD  component  The  core  task  and  the 
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products  and  services  required  of  an  IAC  are  intended  to  provide  both  function  and 
resources  for  the  IAC  that  establishes  and  sustains  a  critical  mass  of  capability  and  services. 
The  IAC's  core  program  is  the  basis  for  the  capability  and  the  reputation  of  the  IAC  as  a 
Center  of  Excellence  in  its  discipline  or  mission  area.  These  capabilities  and  reputation,  in 
turn,  serve  to  attract  additional  tasks  funded  directly  by  the  military  departments.  Defense 
agencies,  OSD,  or  other  agencies  of  the  U.S.  government. 

Several  DoD  IACs  have  also  begun  to  offer  "block  funded"  products  and  services 
in  recent  years.  These  products  and  services  are  similar  to  those  funded  under  the  core; 
they  are  provided  by  the  IAC  to  one  or  more  users  who  agrees  in  advance  to  fund  under  a 
separate  arrangement  specific  products  or  services  which  are  similar  to  those  provided  by 
the  IAC  to  core  users.  "Block  funded"  products  may  be  provided  to  a  single  user  for  a 
single  fee,  or  may  be  provided  to  multiple,  specific  users,  under  an  arrangement  in  which 
several  users  agree  to  the  "pooling"  of  their  resources  so  that  an  IAC  may  undertake  a 
larger  effort  on  their  collective  behalf  than  would  be  possible  to  undertake  for  each  user 
seeking  to  sponsor  an  analysis  effort  on  its  own. 

Block  funded  products  and  services  are  often  described  by  the  IAC  Program  Officer 
as  though  they  were  core  products  or  services.  While  block  funded  products  and  services 
resemble  handbooks,  data  books,  state-of-the-art  reports,  critical  reviews,  and  conferences 
which  might  be  appropriate  for  core  fund  support,  they  are  really  examples  of  the  second 
category  of  IAC  analyses  and  activities. 

C.  SPECIAL  TASKS 

The  DoD  Information  Analysis  Center  Regulation  and  its  implementing  contracts 
provide  for  special  studies  and  analyses  of  information  tailored  to  individual  requirements 
of  specific  U.S.  Government  agencies  on  a  task  order  basis.  The  special  studies  and  tasks 
must  fall  within  the  contract  scope  of  the  basic  contract  as  determined  by  the  Contracting 
Officer  subject  to  the  advice  of  the  Contracting  Officer’s  Technical  Representative  or 
Contract  Technical  Monitor. 

Special  studies  and  tasks  generally  involve  the  preparation  of  a  study  or  an  analysis 
on  die  basis  of  specialized  data  or  information  base  and  on  the  expertise  resident  at  the  IAC. 
Such  expertise  may  take  the  form  of  an  expert  staff  member,  an  expert  available  to  the  IAC 
through  association  with  the  IACs  parent  organization,  or  the  ability  of  IAC  staff  to  search 
its  collection  of  data,  supplement  existing  data  from  other  sources,  and  analyze  information 
in  the  context  of  the  requiring  agency's  specific  need.  Special  studies  cr  special  tasks  are 


undertaken  on  a  cost  reimbursement  basis  upon  the  approval  of  the  IAC  COTR/CTM  and 
upon  receipt  of  funds  by  the  Procuring  Contracting  Officer's  agency  from  the  requiring 
U.S.  government  organization. 

As  will  be  described  in  greater  detail,  special  studies  and  tasks  make  up  the  bulk  of 
the  information  analysis  work  undertaken  by  each  IAC  included  in  the  representative 
sample  study.  The  special  studies  and  tasks  cover  a  broad  spectrum  of  information 
activities.  Some  special  studies  and  tasks  have  included  the  preparation  of  a  state-of-the-art 
report  or  critical  review  on  a  particular  technology  or  analytical  technique  for  a  specific  DoD 
component  The  result  of  this  effort  has  frequently  been  included  in  the  IAC  collection  and 
made  available  to  other  IAC  users.  Other  special  studies  and  tasks  have  involved  the 
analysis  and  synthesis  of  information  leading  to  knowledge  in  new  forms.  IACs  have  been 
asked  to  collect  and  analyze  data  to  verify  that  data  reported  in  existing  literature  was 
actually  generated  using  the  methods  reported.  IACs  have  been  asked  to  develop  new 
analytical  techniques  or  data  collection  methods  to  obtain  data  similar  to  that  reported  in  the 
literature  at  lower  cost  or  with  greater  reliability.  IACs  have  been  asked  to  expand  existing 
data  bases  or  knowledge  bases  in  order  to  take  advantage  of  the  economies  of  scale  that 
arise  when  adding  increments  to  existing  information  bases. 

The  benefits  to  DoD  of  several  IAC  special  studies  and  tasks  are  described  in 
Chapters  4, 5,  and  6  of  this  report,  as  well  as  in  the  earlier  IDA  pilot  IAC  study.11 

D.  IAC  PROGRAM  DEVELOPMENTS,  FY  1987-FY  1989 

1.  Funding  Profile 

Over  the  past  few  years,  the  DoD  Information  Analysis  Center  Program  has  not 
enjoyed  consistent  executive  or  legislative  support  for  stable  or  increasing  levels  of 
funding.  Table  2-2,  based  on  figures  compiled  by  the  IAC  Program  Office  within  the 
Defense  Technical  Information  Center,  illustrates  the  lack  of  consistent  budget  support 
from  either  the  Department  of  Defense  or  the  Congress.  The  IAC  Program  has  been 
subjected  to  reductions  in  the  programmed  level  of  support  within  the  internal  DoD  funding 
cycle.  In  addition,  the  Congress  has  also  imposed  additional  reductions  in  the  program's 
budget  during  the  course  of  its  review  of  the  DoD  budget  These  conscious  reductions  in 
the  IAC  Program's  budget  have  been  further  exacerbated  as  the  result  of  undistributed 


it 


See  especially  "Chapter  VII:  Benefit  Considerations,"  in  Townsicy  and  Frank,  op.  tit.,  pp  63-95. 
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reductions  in  R&D  programs  not  otherwise  protected  from  such  reductions  by  OSD 
directive  or  other  executive  action. 


Table  2-2.  DoO  Information  Analysis  Center  Program 
Recent  Budget  History  for  DLA  Funded  IACs‘ 

(in  millions  of  current  dollars) 


Fiscal 

Year 

Number  of 
IACs  Funded 

Planned 

Program 

Requested 
DoD  Program 

Appropriation 

Actual 

Outlay* 

■n 

8 

$4.0 

$4.0 

$3.64 

$3.64 

9 

3.9 

3.9 

3.64 

2.982 

■9 

8 

3.992 

3.992 

3.613 

3.2 

vJBl: 

9 

5.3 

5.3 

4.0 

4.0 

1984 

10 

7.0 

7.00 

4.934 

4.5 

1985 

11 

5.75 

5.75 

5.75 

5.75 

1986 

11 

6.550 

6.550 

6.550 

4.075 

1987 

12 

7.926 

7.0 

5.0 

4.579 

1988 

13 

8.6** 

5.2 

5.175 

4.883 

1989 

13 

7.393 

5.2 

5.2 

5.2*** 

1990 

13 

7.776**** 

1 

6.2**** 

i 

1 _ 

*  DTIC  oudget  panning  records  for  FY  1988-1991  dated  15  November  1988. 

*  Reflects  available  funds  following  a  distribution  of  -unallocated*  reductions  in  available  RDT&E  funds 
due  to  end  of  year  and  Gramm-Rudman-Hollings  budget  adjustments. 

*'  Includes  start-up  funds  for  an  IAC  procurement  which  was  canceled  due  to  lack  of  appropriated 
funds. 

***  Estimated  outlay  at  conclusion  of  current  fiscal  year. 

****  Estimate  based  on  5  percent  growth  over  previous  fiscal  year. 

In  Tabic  2-2,  the  column  Planned  Program  refers  to  funds  required  to  meet  the  core 
programs  anticipated  by  DoD  at  the  time  the  contract  for  basic  IAC  services  was  concluded 
by  DLA,  by  other  military  departments  relying  DLA  funding  for  their  IAC  contract 
funding,  plus  additional  sums  for  new  IAC  starts  and  IAC  program  management  activities. 
Contract  requirements  for  core  funding  reflect  the  judgment  of  an  IACs  proponent  and 
DDDR/^H  as  to  the  minimum  level  of  core  service  to  be  provided  by  the  IAC  at  the  time  an 
IAC  is  authorized.  The  Planned  Program  column  may  also  include  funds  for  program 
management  and  oversight  In  the  past  program  management  funds  have  been  allocated  to 
pay  some  COTR  support  costs  associated  with  IAC  Program  meetings  or  other  activities 
of  the  DoD  IACs.  Such  funds  have  also  been  allocated  to  pay  for  at  least  a  portion  of 
special  DTIC  efforts  to  publicize  or  market  DoD  Intormation  Analysis  Centers. 


The  column  labeled  Requested  DoD  Program  is  the  level  of  funding  requested  by 
DoD  in  its  annual  consolidated  budget  submission  to  the  Congress.  The  column  labeled 
Appropriation  (As  Adjusted)  refers  to  the  final  appropriated  dollar  amount  for  the  program 
plus  or  minus  such  reprogrammings  specifically  agreed  to  or  accepted  by  the  Congress.  It 
is  an  end  of  Fiscal  Year  figure.  The  last  column.  Actual  Outlay,  records  the  amount  of 
funds  expended  by  DLA  in  support  of  the  program.  This  last  column  shows  the  impact  of 
unallocated  reductions  in  DoD  funding  when  programs  are  not  protected  from  such 
reductions  by  direction  of  the  Secretary  of  Defense. 

The  data  show  that  the  IAC  Program  is  operating  today  in  terms  of  outlay  at  about 
the  level  anticipated  by  the  program  in  the  early  1980s.  Based  on  data  collected  from 
interviews  with  IAC  Directors  and  IAC  users,  the  gap  between  requested  funding  and 
actual  funding  appears  to  have  had  a  significant,  adverse  impact  on  IAC  program  activities. 

In  addition  to  the  general  weakness  in  core  funding  support,  the  Department  of 
Defense  and  the  Congress  have  failed  to  support  existing  IACs  at  the  same  level  in  constant 
dollar  terms  as  was  the  case  in  FY  1971.  Table  2-3  illustrates  the  long  term  effect  of 
inflation  on  the  DoD  IAC  program. 

In  FY  1971,  the  IAC  program  was  funded  at  $2.3  million.  Of  this  amount,  some 
$1,880  million  was  spent  at  IACs  which  exist  today  or  which  have  direct  successors  who 
perform  similar  functions.  These  figures  translate  into  FY  1990  dollars  at  approximately 
$7.2  million  for  all  IACs  in  existence  in  1971  and  $5,778  million  for  those  which  continue 
to  exist  in  one  form  or  another  in  FY  1990. 

During  the  period  FY  1972  through  FY  1988,  several  new  IACs  were  added  to  the 
DoD  Information  Analysis  Centers  Program.  In  some  instances,  these  IACs  were  formed 
by  consolidating  operations  from  several  IACs  into  one  new  IAC;  in  other  cases,  new  IACs 
were  formed  to  meet  the  needs  of  emerging  DoD  technology  thrust  areas.  A  small  number 
of  DoD  IACs  were  disestablished  . 

The  data  presented  in  Table  2-3  show  that  DLA  would  have  to  substantially  increase 
the  proposed  level  of  funding  in  FY  1990  from  $6.2  million  to  approximately  $i 2.4  million 
if  it  wished  to  provide  the  IACs  with  the  same  level  of  constant  dollar  (buying  power) 
support  they  enjoyed  in  FY  1971  or  in  the  fiscal  years  during  which  younger  IACs  were 
started.  This  level  of  support  is  needed  to  sustain  the  DoD  Information  Analysis  Centers 
Program  at  the  level  for  each  IAC  as  envisioned  by  its  proponent  or  by  DDDR&E  at  the 
time  it  approved  the  establishment  of  the  DoD  IAC  under  a  DLA  contract 
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Table  2-3.  IAC  Buying  Power: 

FY  1971,  Year  of  Start  Up,  and  FY  1990* 


I 

I 


FY  1971  In 
FY  1971  $ 


$2,334,000 


$730,000 


$405,000 


$300,000 


$290,000 


$155,000 


Initial  Year 
In  Then  Year 

$ 


1974 

$400,000 


1977 

$375,000 


1978 

$550,000 


1980 

$590,000 


1984 

$500,000 


1984 

$750,000 


1986 

$500,000 


1988 

$750,000 


TOTAL  IAC  FROGRAM  FY  1990  COSTS  AT 
FY  1971/START  UP  BUYING  POWER 


TOTAL  IAC  PROGRAM  PROPOSED  BY  DLA 
FOR  FY  1990 


FY  1990 

Funding  to  Retain 
FY  1971  or  Start  Up 
Buying  Power** 


$7,177,121 


$2,244,772 


$1,245,387 


$922,509 


$891,578 


$476,629 


$1,059,602 


$747,905 


$1,023,636 


$914,728 


$606,354 


$309,531 


$571,689 


$807,493 


$12, *21, 813 


$6,290,000 


Based  on  ’Information  Analysis  Centers  Five  Year  Plan,  Fiscal  Years  1975-1980,*  Defense  Supply 
Agency,  1  August  1974,  and  ’Direct  Core  Funding  by  Fiscal  Year,’  Information  Analyst  Center  Program 
Office,  Defense  Technical  Information  Center,  October  24,  1989, 

Conversion  Factors  extracted  from  "National  Defense  Budget  Estimates  for  fY  1990/1991,’  Office  of 
the  Assistant  Secretary  of  Defense  (Comptroller),  March  1989,  p.  52  (RDTE  column)  used  wore  as 
follow*: 


From 

to  FY  1990 

From 

to  FY1990 

FY  1971 

32.52 

FY  1984 

82.46 

FY  1974 

37.75 

FY  1988 

87.46 

FY  1977 

50.14 

FY  1 983 

92.80 

FY  1978 

53.73 

FY  I960 

64.50 

The  lack  of  financial  support  for  the  DoD  LAC  core  program  has  had  significant 
consequences  for  both  the  IACs  and  the  DoD  research  and  engineering  programs  they  are 
intended  to  support.  Among  the  adverse  consequences  for  the  program  mentioned  were:12 

•  Reduced  production  of  handbooks,  state-of-the-art  reports,  and  other  similar 
reference  works; 

•  Poor  morale  and  resulting  low  productivity  at  individual  IACs; 

•  Significant  delays  in  the  production  of  reference  materials  and  other  core 
products; 

•  Significant  reduction  in  the  level  of  effort  devoted  to  the  collection,  cataloging, 
indexing,  and  maintenance  of  core  collections  in  favor  of  more  lucrative,  but 
perhaps  more  specialized,  collections  supporting  special  tasks. 

The  IAC  Directors  and  others  familiar  with  the  program  argue  that  these 
consequences  of  reduced  funding  for  the  core  IAC  program  have  adversely  impacted  the 
DoD's  research  and  development  program.  The  inability  of  the  IACs  to  maintain  the 
currency  of  their  data  bases,  and  reference  works  derived  from  them,  undermines  their 
value  to  the  user  community  in  several  ways.  Outdated  reference  works  increase  costs  of 
getting  information  into  the  hands  of  users  within  DoD  and  its  contractor  community.  This 
in  turn  impedes  the  transition  of  innovative  scientific  and  technical  developments  from  the 
laboratory  to  engineering  development,  test,  and  production.  As  a  consequence,  the 
acquisition  cycle  is  extended.  In  certain  areas  where  IAC  handbooks  are  used  as  standards, 
as  in  the  case  of  aerospace  structural  materials,  the  use  of  outdated  information  can  actually 
impede  the  growth  and  development  of  technology  thrusts  of  great  interest  to  DoD. 

During  this  phase  of  our  evaluation  of  DoD  Information  Analysis  Centers  Program, 
we  spoke  with  several  DoD  scientists  and  engineers  who  had  used  one  or  more  DoD  IACs 
over  a  period  of  years.  Several  expressed  the  view  that  the  decline  of  support  for  core  IAC 
programs  was  hindering  their  individual  research  and  engineering  activities. 

The  issue  of  IAC  effectiveness  has  become  pressing  over  the  past  few  years 
because  of  several  concurrent  trends.  Funding  levels  have  not  kept  pace  with  inflation, 
putting  a  squeeze  on  the  ability  of  IACs  to  maintain  a  critical  mass  of  people,  facilities,  and 
information.  At  the  same  time,  the  technological  content  of  weapon  systems  has  increased. 
Interest  in  establishing  IACs  by  various  military  components  or  DoD  Agencies  has  also 


12  See  Mr.  L.  Gonzalez,  Director,  MetaJ  Matrix  and  Composites  Information  Analysis  Center,  "Impacts 
of  Budget  Reductions  in  the  Core  Funding  on  Operations  at  the  MMCIAC,"  October,  1986. 
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increased,  despite  the  reduction  in  buying  power  of  the  DoD  Information  Analysis  Center 
program  measured  in  terms  of  available  core  funds. 

2 .  New  Starts 

During  the  early  1980s,  two  new  Information  Analysis  Centers  were  initiated  with 
minimal  DTIC  financial  support  because  of  a  strong  need  on  the  part  of  the  military 
departments  and/or  other  DoD  agencies  for  such  support.  The  Survivability/Vulnerability 
Information  Analysis  Center  (SURVIAC)  was  started  because  of  concern  by  the  Joint 
Technical  Task  Group  on  Aircraft  Survivability  over  the  lack  of  standardized  models  of 
aircraft  vulnerability  and  munitions  effectiveness  against  different  types  of  airframes  and 
aircraft  components.  Several  activities  including  the  maintenance  of  existing  data  bases 
were  combined  into  SURVIAC  in  order  to  provide  better  support  to  the  aircraft  design 
community.  The  Chemical  Warfare/Biological  Defense  Information  Analysis  Center  was 
started  to  capture  and  make  available  existing  research  and  development  results  in  the  field, 
preserve  research  results  of  special  historical  significance,  and  assist  DoD  in  the  collection, 
synthesizing,  and  dissemination  of  information  bearing  on  the  conduct  of  operations  in  a 
battlefield  contaminated  by  nuclear/biological/chemical  agents. 

In  these  instances  substantial  commitment  of  funds  by  the  military  departments  was 
made  to  initiate  and  sustain  core  information  analysis  center  programs  for  an  initial  period 
of  time  with  the  expectation  that  DLA/DTIC  would  assume  its  role  in  providing  continuing 
support  from  the  DoD  Information  Analysis  Center  Program  Element.  Unfortunately,  the 
funding  level  of  the  DLA/DTIC  program  was  not  expanded  to  provide  full  funding  as 
provided  by  contract  with  the  established  LAC  program  and  provide  full  contract  support  to 
new  LACs  as  well.  As  a  result,  the  establishment  of  new  IACs  in  the  DoD  LAC  program 
occurred  at  the  expense  of  at  least  a  portion  of  core  funding  for  existing  IACs. 

In  fiscal  year  1988,  the  DoD  IAC  program  added  the  Crew  Systems  Ergonomics 
Information  Analysis  Center.  This  center,  operated  by  the  University  of  Dayton,  is 
intended  to  provide  vehicle  design  engineers  with  the  basic  information  needed  to  improve 
the  man-machine  interface  in  all  vehicles  designed  for  use  by  U.S.  and  allied  armed  forces. 

The  EDA  study  team  had  an  opportunity  to  observe  a  thoroughgoing  review  and 
debate  within  the  IAC  Executive  Council,  an  advisory  body  to  the  Administrator  of  the 
Defense  Technical  Information  Center,  on  the  merits  of  proceeding  with  the  procurement  of 
this  new  IAC  on  at  least  two  occasions  during  the  period  just  prior  to  the  announcement  of 
the  solicitation.  The  principal  reservations  voiced  by  members  of  the  IAC  Executive 
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Council  regarding  the  establishment  of  a  new  IAC  was  the  adverse  impact  a  new  IAC 
would  have  on  the  resources  available  to  existing  IACs. 

3.  Desired  New  Starts/Restarts 

In  addition  to  SURVIAC,  CBIAC,  and  CSERIAC,  which  have  all  begun 
operations  during  a  period  in  which  the  DoD  IAC  program  budget  remained  flat,  there  have 
been  ongoing  discussions  of  the  expansion  of  the  existing  IAC  program.  There  has  been 
interest  in  the  reestablishment  of  one  IAC  which  has  been  disestablished  (Shock  and 
Vibration  Information  Analysis  Center).  DTIC  completed  all  but  the  award  phase  of  a  new 
IAC  in  the  field  of  corrosion  in  FY  1987  but  had  to  withdraw  the  procurement  due  to  a  lack 
of  funds.  DoD  is  experiencing  continuing  demand  from  the  military  departments  for 
information  analysis  support  to  combat  the  effects  of  corrosion  on  military  equipment. 
This  need  continues  to  be  unmet.  Discussions  with  DoD  staff  suggest  continuing  interest 
in  an  information  analysis  activity  to  provide  support  in  such  areas  as  electronics,  materials, 
robotics,  artificial  intelligence,  and  several  other  areas  of  promising  advanced  technology  of 
interest  to  one  or  more  DoD  components. 

The  military  departments  desiring  to  establish  new  IACs  in  the  future  may  follow 
the  CBIAC  and  CSERIAC  models.  In  these  instances  the  services  put  up  the  bulk  of  the 
funds  necessary  to  fund  the  core  operations  of  the  IAC  for  the  first  two  years,  and  may 
continue  to  do  so  long  after  the  rime  w hen  DLA  has  traditionally  picked  up  LAC  funding  in 
its  budget  line  item.  If  the  new  IACs  desired  by  the  military  departments  are  started  within 
the  current  fiscal  and  budgetary  regime,  the  result  will  be  further  dilution  of  DoD  IAC 
program  funds  across  an  expanded  set  of  DoD  IACs. 

E.  THE  REPRESENTATIVE  SAMPLE  OF  DOD  IACS 

This  report  examines  three  DoD  Information  Analysis  Centers  to  develop  and  apply 
further  a  study  methodology  that  permits  the  evaluation  of  the  benefits  and  costs  of  DoD 
Information  Analysis  Centers  and  their  contribution  to  the  DoD  research  and  engineering 
program.  In  the  following  chapter,  the  method  by  which  CBIAC,  GACIAC,  and  RAC 
were  selected  for  review  and  the  process  of  detailed  review  of  IAC  benefits  will  be 
discussed. 
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3.  REPRESENTATIVE  IAC  SAMPLE 
STUDY  METHODOLOGY 


A.  OPERATIONAL  AUDIT  APPROACH 

The  basic  methodology  applied  by  IDA  to  the  evaluation  of  the  DoD  Information 
Analysis  Centers  Program  borrows  heavily  from  techniques  used  to  conduct  performance 
audits  by  various  auditing  agencies  of  the  U.S.  Government.11  The  approach  was  tested 
in  EDA's  pilot  IAC  study  and  was  found  to  be  an  effective  mechanism  to  gather  information 
needed  to  assess  the  benefits  of  IAC  products  and  services.  In  addition,  the  operational 
audit  approach  also  permitted  the  collection  of  information  needed  to  evaluate  the  efficiency 
and  effectiveness  of  IAC  contract  administration,  management,  and  program  oversight. 

The  basic  approach  taken  by  IDA  in  both  the  pilot  study  and  the  representative  IAC 
sample  study  was  as  follows: 

•  Identify  program  goals  and  objectives  as  articulated  by  DoD  directives,  policy 
statements  by  authoritative  DoD  spokesmen,  and  senior  program  managers, 

•  Identify  or  develop  appropriate  quantitative  and  qualitative  measures  of  merit  to 
be  used  in  assessing  the  cost,  benefit,  effectiveness,  and  performance  of 
individuals  and  organizations  participating  in  the  management,  oversight, 
operation,  and  evaluation  of  the  DoD  Information  Analysis  Center  Program, 


13  See  especially  Policy  and  Procedures  Manual  for  Guidance  of  Federal  Agencies :  Title  3:  Audit 
(Washington,  DC:  U.S.  General  Accounting  Office,  no  date)  and  Government  Auditing  Standards 
(1988  Revision),  (Washington,  DC:  U.S.  General  Accounting  Office,  1989).  For  additional 
discussion  of  operational  or  performance  audits,  see  the  following  references:  Darwin  J.  Casler,  James 
R.  Crockett,  and  Richard  Holman,  Editors,  Operational  Auditing:  An  Introduction  (Altamonte 
Springs,  FL:  Institute  of  Internal  Auditors  (1982);  Dale  L.  Flesher  and  Steward  Siewert,  Independent 
Auditor's  Guide  to  Operational  Auditing  (New  York:  Wiley,  1982);  Bradford  Cadmus  and  J.  Arnold 
Bade,  Operational  Auditing  Handbook  (Altamonte  Springs,  FL:  Institute  of  Internal  Auditors,  1964). 
In  addition,  see  the  following  articles  for  discussions  of  operational  auditing  of  activities  which  arc 
relevant  to  the  method  used  in  this  study:  JJ.  Dalton,  "The  Operations  Review  Process:  An 
Independent  Evaluation  of  Performance,"  Topics  in  Health  Care  Financing,  Vol.  10,  No.  2  (Winter 
1983),  pp.  22-28;  RJ.  Knoll  and  T.N.  Howard,  "What  Is  Operational  Auditing?,"  Topics  in  Health 
Care  Financing,  Vol.  10,  No.  2  (Winter  1983),  pp.  1-11;  TJ.  Gruber,  "The  Operational  Audit-- An 
Integrated  Approach,"  Internal  Auditor,  Vol.  40,  No.  4  (August  1983),  pp.  39-42;  J.  Simke, 
"Management,  Operational  and  Comprehensive  Auditing:  Extending  Traditional  Boundaries," 
CA  Magazine,  Vol.  115,  No.  6  (June  1982),  pp.  52-56. 
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•  Develop  questionnaires  and  other  instruments  needed  to  collect  data  bearing  on 
the  measures  of  merit  appropriate  to  each  organization  participating  in  the 
management,  oversight,  operation,  or  evaluation  of  DoD  Information  Analysis 
Centers, 

•  Conduct  interviews  and  review  records,  where  appropriate,  in  order  to  collect 
data,  and 

•  Analyze  data  collected  during  the  field  survey  phase  of  the  study. 

Attempts  by  other  U.S.  Government  agencies  to  develop  methods  for  assessing  the 
performance  of  their  information  analysis  centers  proved  unsatisfactory  as  models  for  IDA. 
For  example,  the  study  done  for  the  Department  of  Energy  attempting  to  quantify  benefits 
to  DoE  resulting  from  its  scientific  and  technical  information  program  (STIP)  lumped  all 
STIP  activities  together  and  derived  an  aggregate  benefit  measured  in  terms  of  billions  of 
dollars.  Many  of  these  STIP  activities  differ  from  DoD  LAC  activities;  furthermore,  IDA 
concluded  that  the  methodology  used  to  compile  dollar  value  of  benefit  was  not  reasonable 
if  applied  to  the  DoD  LAC  program.14 

In  the  case  of  the  National  Science  Foundation  effort  to  assess  its  information 
analysis  activities,  EDA  concluded  that  the  range  of  DoD  information  management/ 
information  security  controls  as  well  as  the  general  manner  in  which  DoD  IACs  operate 
made  the  NSF  study  methodology  an  inappropriate  model.  While  IDA  sought  to  borrow 
analytical  techniques  as  appropriate,  the  differences  between  NSF-sponsored  IACs  located 
at  colleges  and  universities  in  1974-1976  and  DoD-sponsored  IACs  located  at  not-for-profit 
or  for-profit  institutions  operating  in  the  1980s  appear  to  be  substantial.13 

3 .  DEVELOPMENT  OF  INTERVIEW  INSTRUMENTS 

In  order  to  better  understand  the  operation  and  management  of  the  DoD  LAC 
program  as  well  as  the  benefits  and  costs  of  the  program  to  DoD  and  its  contractors,  EDA 
developed  a  set  of  questionnaires  to  be  used  in  interviews  for  each  of  the  major  participants 
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14  King,  Donald  W„  Jose-Marie  Griffiths,  Ellen  A  Sweet,  and  Robert  R.  V.  Wiederkehr,  A  Study  of  the 

Value  of  Information  and  the  Effect  on  Value  of  Intermediary  Organizations,  Timeliness  of  Services  &  _ 

Products,  and  Comprehensiveness  of  the  EDB  (Rockville,  MD:  King  Research,  Inc.  for  Technical  ® 

Information  Center,  Office  of  Scientific  and  Technical  Information,  United  States  Department  of 
Energy,  September  1984). 

13  Robert  W.  Mason,  et  al..  Development  of  Cost  Benefit  Methodology  for  Scientific  and  Technical 
Information  Communication  and  Application  to  Information  Analysis  Centers  (Atlanta,  GA:  Metrics 
Inc.,  for  the  National  Science  Foundation,  SIS  75-12741,  1977)  and  A  Study  of  the  Perceived  Benefits 
of  Information  Analysis  Center  Services  (Atlanta,  GA:  Metrics  Inc.,  for  the  National  Science  • 

Foundation,  DSI-7718035,  March  1979). 
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in  the  IAC  system  as  identified  in  the  DoD  Directive.  Among  the  key  actors  for  whom 
interviews  were  anticipated  at  the  beginning  of  this  study  were  the  following: 

•  IAC  Directors  and  their  staffs 

•  IAC  Procuring  Contracting  Officers 

•  IAC  Contracting  Officer’s  Technical  Representative/Contract  Technical 
Monitor 

•  DoD  Program  Monitors 

•  IAC  Program  Office 

•  IAC  Core  Activity  Users 

•  IAC  Special  Task  Users  (Task  Monitors) 

•  Administrator  of  DTTC 

•  The  Director  of  Technical  Services,  Defense  Logistics  Agency 

•  The  Executive  Director  of  Contracting,  Defense  Logistics  Agency 

•  Members  of  the  Contract  Review  and  Contracting  Policy  Staffs,  Defense 
Logistics  Agency 

•  Defense  Electronics  Supply  Center  staff  responsible  for  DoD  IAC  activities 

•  Staff  at  the  regional  offices  of  Defense  Contract  Administration  Services 
responsible  for  contract  oversight  and  payment  cf  DoD  IAC  contractors.16 

A  general  questionnaire  was  prepared  and  was  significantly  tailored  or  modified  to 
elicit  information  regarding  the  specific  responsibilities  of  each  individual  for  IAC 
programming,  budgeting,  operations,  management,  oversight,  and  performance  evaluation. 
Each  questionnaire  was  reviewed  with  the  sponsor  and  further  modified  in  order  to  elicit 
additional  information  that  might  be  helpful  in  obtaining  both  direct  and  indirect  evidence  of 
costs  and/or  benefits  of  the  IAC  program  to  DoD. 

IDA  did  not  attempt  to  mail  questionnaires  to  IAC  Directors  or  IAC  users  for  three 
reasons.  First,  we  did  not  wish  to  subject  the  study  to  the  uncertainties  associated  with 
Office  of  Management  arid  Budget  review  and  approval  of  survey  instruments.  Second, 
our  experience  in  the  pilot  IAC  study  suggested  that  sterile  mail  surveys  would  be  unlikely 
to  elicit  information  most  useful  in  understanding  and  quantifying  the  benefits  provided  to 
DoD  and  contractor  users  of  Information  Analysis  Centers.  Third,  we  were  concerned  that 
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1 6  Headquarters  staff  of  the  Defense  Logistic  Agency  concerned  with  DoD  Information  Analysis  Centers 
Program  will  be  interview  ed  further  during  subsequent  phases  of  this  study. 
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a  simple  mail  survey  would  not  result  in  a  statistically  significant  sample  of  IAC  users.  On 
balance,  we  concluded  that  the  time  and  effort  associated  with  detailed  interviews  with  IAC 
program  participants  would  result  in  the  timely  collection  of  more  meaningful  information 
than  would  mailed  surveys. 

In  the  case  of  both  the  IAC  Director  and  the  IAC  COTR,  we  sought  answers  to 
questions  which  would  illuminate  the  following  subject  areas  from  their  respective  vantage 
points:17 

•  What  are  the  IAC  Program  goals  and  objectives? 

•  How  does  the  Core  program  of  the  IAC  fulfill  these  goals  and  objectives? 

•  How  does  the  Special  Studies  and  Special  Tasks  program  of  the  IAC  fulfill 
these  goals  and  objectives? 

•  How  is  the  IAC  organized?  How  is  the  Defense  Department  organized  to 
oversee  and  manage  the  IAC's  contact? 

•  How  is  the  IAC  operated?  How  does  the  Defense  Department  carry  out  its 
oversight  and  contract  management  of  the  IAC's  contract? 

•  What  problems  and  opportunities  for  additional  or  alternative  core  and  special 
tasks  has  the  IAC  encountered?  What  steps  were  taken  and  by  whom  to 
alleviate  these  problems  and  facilitate  the  provision  of  products  and  services  by 
the  IAC  to  the  Defense  Department,  other  U.S.  Government  agencies.  Defense 
Department  contractors,  and  other  authorized  users  of  IAC  core  products  and 
services  or  special  task  services? 

These  questions  were  framed  in  large  measure  to  help  identify  the  specific  benefits 
to  DoD  that  had  accrued  as  a  result  of  either  core  or  special  tasks  performed  by  the  IACs 
included  in  our  study.  We  sought  to  understand  the  conditions  under  which  IAC  products 
and  services  had  been  most  helpful  to  DoD  as  measured  by  IAC  users  and/or  DoD  program 
managers  whose  programs  were  affected  by  IAC  products  and  services. 

As  the  study  progressed,  the  range  of  interviewees  broadened  to  include  a 
considerable  number  of  special  task  users  as  well  as  several  consumers  of  core  products 
and  services. 


1 7  See  Appendix  C  for  a  copy  of  the  basic  questionnaire  that  was  used  to  structure  interviews  with  IAC 
Directors,  IAC  Technical  Monitors,  and  IAC  Special  Task  Users. 


C.  REPRESENTATIVE  SAMPLE  SELECTION  CRITERIA 


The  purpose  of  conducting  a  study  of  a  representative  sample  of  DoD  Information 
Analysis  Centers  v/as  threefold: 

•  To  apply  a  methodology  developed  in  the  pilot  LAC  study  to  examine  the 
benefits  and  costs  to  the  DoD  research  and  engineering  program; 

•  To  assess  specific  benefits  that  had  been  obtained  from  the  IAC's  examined; 
and 

•  To  assess  IAC  program  management  and  administration  and  set  forth 
alternatives  to  improve  the  program  if  found  to  be  warranted 

During  May  and  June,  1988,  IDA  met  with  R&AT  and  the  IAC  Program  Office 
staff  to  discuss  a  number  of  factors  which  might  be  significant  in  helping  to  judge  the 
benefits  and  costs  of  the  entire  DoD  IAC  program  to  the  DoD  research  and  engineering 
program.  Although  the  pilot  study  was  still  being  circulated  for  comment  within  OSD, 
DLA,  and  DTIC,  a  consensus  developed  a  sound  set  of  criteria  which  could  be  used  in 
screening  remaining  LACs  for  inclusion  in  the  representative  sample  phase  of  the  study. 
We  were  guided  in  our  selection  process  by  the  concept  that  at  least  some  IAC  members  of 
the  representative  sample  should  demonstrate  characteristics  in  users,  information  acquired, 
organizational  history,  and  relationships  with  the  contracting  process  at  variance  with 
NTLAC.  Among  the  more  specific  criteria  used  tc  screen  the  remaining  LACs  were  the 
following: 

•  Focus  of  LAC  not  in  the  field  of  materials  science 

•  LAC  users  from  the  research  and  engineering  community,  especially  those 
funded  from  budget  category  6. 1  through  6.3A  funds 

•  LAC  work  being  performed  substantially  in  subject  areas  subject  to  export 
controls  and/or  national  security  classification 

•  LAC  in  the  initial  contract  period  with  the  Defense  Logistics  Agency 

•  LAC  with  a  Contracting  Officer's  Technical  Monitor  aot  on  the  OSD  staff 

•  IAC  whose  Procuring  Contracting  Officer  was  not  a  DLA  staff  member. 

In  addition  to  these  criteria  which  migfn  have  some  bearing  on  the  work  of  an  IAC, 
our  pilot  study  raised  several  questions  about  the  defense  of  the  IAC  core  program  in  me 
DoD  budget  process  (including  the  Congress),  the  administration  of  the  contract,  and  the 
role  of  various  institutions  in  the  oversight  of  IAC  performance.  Accordingly,  we  sought 


and  were  granted  permission  to  expand  the  scope  of  the  study  to  include  at  least  one  IAC 
completely  outside  the  existing  family  of  DLA-sponsored  or  DLA-affiliated  IACs. 

After  several  conversations  with  R&AT  staff,  DTIC  staff,  and  several  IAC  COTRs, 
four  IACs  were  selected  for  inclusion  in  the  sample  to  be  examined  in  this  phase  of  the 
overall  study.  Evaluation  of  the  DoD  IAC  Program: 

•  Tactical  Weapon  Guidance  and  Control  Information  Analysis  Center 
(GACIAC),  operated  under  contract  to  DLA  by  ITT  Research,  Inc.; 

•  Chemical  Warfare/Biological  Defense  Information  Analysis  Center  (CBIAC), 
operated  'under  contract  tc  DLA  by  Battelle  Memorial  Laboratories; 

•  Reliability  .Analysis  Center  (RAC),  operated  under  contract  to  the  Air  Force  by 
HT  Research,  Inc.;  and 

•  DoD  Nuclear  Information  Analysis  Center  (DASIAC),  operated  under  contract 
to  die  Defense  Nuclear  Agency  by  Kaman  Sciences-Tempo  Division. 

Each  IAC  selected  exemplifies  one  or  more  characteristics  which  differentiate  it 
from  NTIAC,  the  object  of  the  pilot  study.  Each  also  has  much  in  common  with  other 
IACs. 

GACIAC  and  CBIAC  operate  in  areas  of  technology  which  are  much  more 
sensitive  from  an  export  control  and  national  security  information  standpoint  than  does 
NTIAC.  GACIAC  and  CBIAC  do  not  have  as  well  developed  a  user  base  in  the 
maintenance  and  logistics  fields  as  did  NTIAC.  Thus,  it  would  appear  that  GACIAC  and 
CBIAC  users  arc  more  heavily  weighted  on  the  side  of  development  and  advanced 
engineering  as  opposed  to  operational  test  and  evaluation  or  even  logistics  and  maintenance 
users  as  was  frequently  the  case  in  the  NTIAC  study. 

GACIAC  and  CBIAC  strongly  resemble  NTIAC  from  the  standpoint  of  contracting 
administration  and  management.  All  three  IACs  operate  under  DLA  contract  with  DLA 
supplying  funds  for  the  core  IAC  program.  The  Reliability  Analysis  Center  represents  an 
alternative  model  for  the  oversight  and  management  of  DLA  funds.  RAC  is  operated  under 
an  Air  Force  contract  which  is  administered  and  managed  by  the  same  organization  which 
also  provides  the  Contracting  Officer's  Technical  Representative.  Unlike  GACIAC, 
CBIAC,  and  NTIAC,  the  RAC  has  no  formal  point  of  contact  on  the  R&AT  staff.  It  is 
possible  that  these  organizational  and  structural  issues  might  bear  on  the  efficiency  and 
effectiveness  of  the  IACs  and  their  sponsor's  oversight  and  management . 
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We  included  DASIAC  in  this  study  of  representative  sample  IACs  because  it 
represents  still  anothe*  model  for  structuring  an  IAC  contract,  as  well  as  administering, 
managing,  and  overseeing  an  IAC  supporting  an  ongoing,  sensitive,  DoD  research  and 
engineering  program.  We  did  not  explore  with  DASIAC  users  the  kinds  of  benefits  that 
resulted  from  its  use.  Accordingly,  there  will  be  no  additional  discussion  of  DASIAC  in 
this  report. 

D.  ADMINISTRATION  OF  SURVEY  INSTRUMENTS 

During  the  course  of  the  pilot  study,  EDA  staff  made  several  trips  to  interview  key 
individuals  involved  in  the  operation,  oversight,  and  management  of  IACs  included  in  the 
representative  sample.  Among  those  individuals  interviewed  specifically  on  the  provision 
of  IAC  products  and  services  were  the  following: 

Mr.  Frederick  Menz,  DDDR&E(R&AT) 

Mr.  Thomas  Dashiel,  DDDR&E(  R&AT) 

Mr.  Howard  Race,  immediate  past  GACIAC  Contracting  Officer’s  Technical 
Representative 

Mr.  Chad  George,  GACIAC  Contracting  Officer's  Technical  Representative 

Mr.  Steve  Lawhome,  CBIAC  Contracting  Officer’s  Technical  Representative 

Mr.  Preston  MacDiarmid,  RAC  Contracting  Officer’s  Technical  Representative 

Mrs.  Sandra  Young,  immediate  past  DASIAC  Contract  Technical  Monitor 

Dr.  Robert  Heaston,  Director,  GACIAC 

Mr.  Fran  Crimmins,  Director,  CBIAC 

Mr.  Steve  Flint,  Director,  RAC 

Mr.  Richard  Rowland,  former  Director,  DASIAC 

Mr.  Bruce  Montoya,  Rome  Air  Development  Center,  U.S.  Air  Force,  Procuring 
Contracting  Officer  for  RAC 

Mr.  K  Flllippi,  Executive  Director,  Technical  Services,  Defense  Logistics  Agency 

Mr.  Kurt  Mulhohn,  Administrator,  Defense  Technical  Information  Center 

Mr.  Paul  Klinefelter,  Director,  Information  Analysis  Center  Program  Office, 

Defense  Technical  Information  Center 

Mr.  Brian  McCabe,  Information  Analysis  Center  Program  Office,  Defense 
Technical  Information  Center 

Mr.  Michael  Poppick,  Contracting  Directorate,  Defense  Logistics  Agency 
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Mr.  Richard  Higginbotham,  Contracting  Directorate,  Defense  Logistics  Agency 

Mr.  Nick  McHenry,  Contract  Review  Branch,  Defense  Logistics  Agency 

Ms.  Kathy  Calhoun,  Contract  Review  Branch,  Defense  Logistics  Agency 

Col  Louis  Diehl,  Defense  Electronics  Supply  Center 

Lt  Col.  Donald  Haverkamp,  Defense  Electronics  Supply  Center 

Ms.  Sara  Williams,  Defense  Electronics  Supply  Center  and  Procuring  Contracting 
Officer  for  GACIAC  and  CBIAC. 

In  addition  to  these  individuals  we  also  interviewed  senior  officials  associated  with 
each  IACs  parent  organization  to  further  examine  whether  or  not  there  were  noteworthy 
differences  among  LACs  operated  under  contract  to  for-profit,  not-for-profit,  or  academic 
institutions. 

We  also  conducted  in-depth  reviews  of  LAC  products  and  procurement  files  at  each 
LAC  and  at  the  Defense  Electronics  Supply  Center.  The  focus  of  the  document  review 
centered  on: 

•  Determination  of  benefits  arising  from  each  LACs  work; 

•  Methods  used  by  each  LAC  to  evaluate  their  own  products  and  services  to 
determine  benefits. 

IDA  staff  also  interviewed  Special  Studies  task  monitor  or  other  key  staff  at  DoD 
facilities  familiar  with  each  special  study  conducted  on  behalf  of  those  activities.  In  several 
instances,  the  special  task  monitor  had  left  the  DoD  activity  before  the  IAC  special  task  had 
been  completed,  or  had  left  subsequent  to  the  completion  of  the  task  but  before  EDA  had 
initiated  the  study  of  the  DoD  IAC  Program.  In  such  instances  we  were  often  able  to  locate 
knowledgeable  individuals  who  were  able  to  provide  information  on  the  benefits  of  the  IAC 
special  study  to  that  DoD  component.  The  results  of  these  interviews  bearing  on  IAC 
benefits  to  DoD  components  and  their  contractors  are  described  in  Chapters  5,  6,  and  7. 
The  results  of  interviews  and  the  review  of  contract  files  are  described  separately. 

IDA  staff  also  contacted  a  number  of  FY  1987  and  FY  1988  consumers  of  selected 
IAC  core  products  and  services  to  develop  data  bearing  on  the  cost  and  benefits  of  such 
products  and  services.18  The  users  contacted  had  been  recipients  of  either  bibliographies 
prepared  by  LAC  or  consumers  of  technical  inquiry  services.  We  did  not  make  a  systematic 


1 8  See  below,  Chapters  4, 5,  and  6  for  a  detailed  discussion  of  IAC  user  views  on  the  benefits  to  DoD  and 
DoD  contractors  dervied  from  use  of  DoD  IACs. 


effort  to  contact  recipients  of  IAC  handbooks,  data  books,  or  newsletters  because  of  the 
very  large  number  of  users  in  these  categories  and  the  rather  vague  purposes  underlying 
their  requests  for  such  core  IAC  products.  The  results  of  these  interviews  are  also  recorded 
in  Chapter  4,  5,  and  6  and  in  a  separate  report  dealing  with  IAC  Program  Administration, 
Management,  and  Oversight 

E.  REPRESENTATIVE  SAMPLE  STUDY  EMPHASIS 

At  the  outset  of  the  task  and  as  documented  in  the  work  plan,  the  purpose  of  the 
representative  sample  study  was  to  further  develop  and  to  apply  a  methodology  to  assess 
the  effectiveness  of  the  DoD  Information  Analysis  Center  Program  in  supporting  the  DoD 
Research  and  Development  program.  At  the  conclusion  of  an  initial  draft  of  the  pilot  IAC 
study,  OSD  asked  IDA  to  continue  to  collect  and  to  present  information  in  the 
representative  sample  phase  of  the  project  in  a  format  suitable  for  use  in  Congressional 
testimony  and  other  discussions  with  senior  Congressional  staff  and  DoD  managers 
regarding  the  IAC  program. 

During  the  course  of  the  pilot  study,  the  IDA  study  team  was  able  to  collect  a  great 
deal  of  information  regarding  the  administration  and  management  of  the  NTIAC  contract. 
The  quantity  and  quality  of  information  collected  during  the  pilot  study  exceeded  initial 
expectations  with  respect  to  issues  of  IAC  contract  administration  and  management.  As  a 
result  of  discussion  with  R&AT  staff  following  the  briefing  to  Dr.  Millbum,  it  was  agreed 
that  IDA  would  accelerate  its  efforts  to  include  appropriate  comments,  alternatives,  and 
evaluations  of  alternatives  to  improve  the  effectiveness  and  efficiency  of  the  operation  of 
the  DoD  IAC  program.  The  information  developed  during  the  representative  sample  study 
regarding  IAC  program  administration,  management,  and  oversight  is  reported  separately. 

F.  SUMMARY 

During  this  phase  of  the  EDA  evaluation  of  the  DoD  Information  Analysis  Centers 
Program,  EDA  applied  a  methodology  developed  in  the  pilot  study  to  evaluate  the 
contribution  of  me  DoD  Information  Analysis  Center  program  to  selected  DoD  research 
activities.  In  addition,  the  study  of  a  representative  sample  of  DoD  IACs  collected  data 
about  IAC  contributions  to  the  DoD  research  and  engineering  program  that  would  support 
near-term  discussions  of  LAC  program  budgets  and  other  resource  requirements.  As  a 
result  of  discussions  with  the  sponsor  and  other  participants  in  the  IAC  program,  the 
inclusion  of  IAC  program  administration  and  management  issues,  alternatives,  and 
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recommendations  was  accelerated  from  the  last  pliase  of  the  IDA  study  to  the  representative 
sample  phase  of  DoD  LAC  program  evaluation.  The  balance  of  this  document  is  devoted  to 
a  discussion  of  the  results  of  IDA's  review  of  the  products  and  services  offered  by  four 
DoD  Information  Analysis  Centers. 


4.  BENEFITS  FROM  CBIAC 


A.  INTRODUCTION 

The  Chemical  Warfare/Biological  Defense  Information  Analysis  Center  was 
chartered  in  1986  to  provide  to  the  DoD  community  authoritative  information  on  chemical 
warfare  and  biological  defense  science  and  technology.  CBIAC  has  developed  in  a 
relatively  short  period  of  time  extensive  bibliographic  data  bases,  portions  of  which  are 
available  to  registered  users  of  the  Defense  Technical  Information  System  through  the 
Defense  Research  On-Line  Systems  (DROLS).  CBIAC  is  also  in  the  process  of 
developing  and  implementing  major  chemical  properties  data  bases  incorporating  in  easily 
accessible  formats  information  on  potential  chemical  warfare  agents,  antidotes,  and 
decontaminating  solutions  dating  back  to  the  interwar  period. 

As  one  of  the  newest  members  of  the  DoD  constellation  of  IACs,  this  LAC  has  had 
funding  problems  for  its  core  program.  Although  promised  $500,000  in  its  contract  with 
the  Defense  Logistics  Agency  for  its  core  program,  DLA  has  been  unable  to  provide  a  full 
allotment  of  core  funds  since  CB IACs  inception.  Accordingly,  CBIAC  has  focused  its 
core  program  efforts  on  collecting  chemical  warfare  and  biological  defense  information, 
answering  technical  and  bibliographic  inquiries,  and  publishing  a  newsletter.  The 
preparation  of  handbooks,  state-of-the-art  reports,  critical  reviews  and  other  written 
products  has  been  deferred  or  has  been  undertaken  as  special  studies  and  tasks  funded 
directly  by  DoD  components  and  subsequently  utilized  as  part  of  the  CBLAC  core  program. 

Funding  for  CBIAC  for  the  period  FY  1986  through  FY  1989  is  summarized  in 
Table  4-1.  This  chart  is  helpful  in  scaling  the  size  and  magnitude  of  CBIAC's  core 
programs  supported  by  DLA  and  additional  service  funds  as  compared  to  its  special  task 
efforts.  CBIAC  is  substantially  smaller  than  most  FFRDCs  supported  by  the  Department 
of  Defense.19 


1 9  See  GAO  Report  on  SDI  Institute  for  further  discussion  of  DoD  FFRDCs. 
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Table  4-1.  CBIAC  Funding  FY  19SS-FY89 


Fiscal  Year 

DLA  Core 
Funding 

Additions1 
Funding  by 
Services* 

Special 

Tasks 

Product 

Sales** 

TOTAL 

1986 

0 

$125,000 

0 

0 

$125,000 

1987 

$100,000 

$250,000 

$4,821,757 

0 

$5,171,757 

1988 

$162,000 

$237,316 

$3,736,538 

0 

$4,135,854 

1989 

$375,000 

0 

$3,322,885 

0 

$3,697,885 

*  Includes  funds  paid  by  the  services  for  additional  core  services  as  well  as  'block  funding'  for  IAC 
special  tasks. 

"  Includes  conference  registration  fees,  serial  and  book  sales,  subscriptions  to  information  services, 
and  other  information  products  as  specified  by  each  IAC. 

The  core  CBIAC  program  employs  two  full  time  professional  analysts,  the  IAC 
Director,  and  two  additional  information  specialists  who  also  perform  some  clerical  duties. 
Special  tasks  performed  by  CBIAC  consume  substantial  portions  of  Battelle  Memorial 
Institute  staff  time. 

B  .  CORE  PROGRAM  DESCRIPTION 

The  CBIAC  core  program  consists  of  several  services.  Users  may  call,  write,  fax, 
or  walk  in  to  CBIAC  to  obtain  information  services  and  support.  CBIAC  operates  a  small 
collection  of  information  at  its  facility  at  the  Edgewood  Area  of  Aberdeen  Proving 
Grounds,  MD.  It  has  computer  links  to  the  central  computer  at  DTTC  where  a  portion  of 
the  CBIAC  abstract  and  bibliographic  information  files  are  stored.  CBIAC  also  has 
unclassified  computer  links  to  the  Battelle  Memorial  Institute  headquarters  in  Columbus, 
OH.  Utilizing  information  available  from  its  local  files  at  Aberdeen  Proving  Grounds,  the 
larger  collection  of  information  at  Battelle  Headquarters,  and  access  to  government  and 
commercial  data  bases,  the  CBIAC  staff  can  provide  a  broad  range  of  information  services 
to  qualified  users  including  bibliographic  assistance,  referrals  to  additional  sources  of 
information,  and  answers  to  technical  inquiries. 

The  kind  of  information  products  provided  by  CBIAC  staff  can  be  divided  Into  two 
broad  categories:  general  distribution  information  products  and  individual  response  items. 
General  distribution  products  are  information  items,  documents,  current  awarenesss 
materials,  or  other  information  products  that  are  prepared  for  distribution  to  all  known  or 
potential  CBIAC  customers.  While  they  may  resoond  to  a  specific  problem  or  inquiry, 
such  items  are  generally  prepared  with  a  single  customer  firmly  in  the  mind  of  the  IAC 


Director,  the  COTR,  or  the  user  community  at  the  time  the  product  was  conceived.  CBIAC 
also  prepares  individual  response  items  under  the  core  program.  These  information 
products  ,'jre  prepared  specifically  in  response  to  a  request  by  one  or  more  identified  users. 
Bibliographies,  referrals  to  specific  sources  of  information  in  response  to  specific  requests, 
and  answers  to  technical  questions  in  response  to  specific  individuals  are  examples  of  this 
latter  category  of  information  product. 

The  only  general  information  product  distributed  during  FY  1987  and  FY  1988  was 
the  CBIAC  Newsletter.  This  document  range  from  four  to  eight  pages  in  length  was 
generally  well  received  by  the  chemical  warfare  community. 

CBIAC  has  handled  a  moderately  large  number  of  individual  response  information 
items  since  its  inception.  During  the  period  calendar  year  1988,  CBIAC  handled  more  than 
300  such  items.  Table  4-2  summarizes  significant  individual  response  core  information 
products  or  services  during  calendar  year  1988  by  military  department,  DoD  component, 
or  contractor. 


Tabla  4-2.  CBIAC  Cora  Individual  Response  Users,  Calendar  Year  1988 
Classification  by  Organization  Type 


Department  of  Defense 

Air  Force 

20 

Army 

88 

Marine  Corps 

1 

Navy 

20 

OSD 

3 

Other  DoD 

5 

Other  U.S.  Government  Agencies 

11 

Department  of  Defense  Contractors 

168 

Batielle 

55 

Other  Contractors 

113 

Academic/Professional  Societies 

2 

Foreign  Governments 

5 

NATO 

3 

Others 

2 

CBIAC  Core  Individual  Response  Population 

323 

CBIAC  has  been  utilized  by  all  military  services  and  many  DoD  components  during 
the  period  examined. 
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C.  BENEFITS  FROM  THE  CORE  PROGRAM 


1.  Benefits  of  General  Distribution  Products 

In  the  case  of  CBIAC,  IDA  did  not  systematically  evaluate  general  distribution 
products  because  of  the  very  limited  number  of  such  items  produced  by  CBIAC.  At  the 
time  IDA  conduced  its  review  of  CBIAC  core  program  products  and  services,  it  had 
produced  only  three  quarterly  newsletters  with  a  fourth  he’d  up  in  the  publishing  process 
due  to  a  lack  of  funds.  Publication  of  planned  handbooks,  state-of-the-art  reports,  and 
critical  reviews  had  also  been  deferred  because  of  a  lack  of  core  funds. 

We  did  review  the  reader  survey  included  in  the  CBIAC  newsletter.  CBIAC 
routinely  conducts  surveys  of  its  user  community  through  the  CBIAC  Newsletter  to  obtain 
feedback  on  its  products  and  services.  We  found  upon  a  review  of  CBIAC's  files  very  few 
questionnaires  included  in  the  newsletter  had  been  returned.  Most  indicated  that  the 
CBIAC  Newsletter  was  helpful,  especially  in  identifying  contracts  recently  awarded  and 
upcoming  conferences  or  meetings.  However,  no  CBIAC  Newsletter  questionnaire 
respondent  indicated  that  the  CBIAC  Newsletter  was  his  or  her  principal  source  of 
information  regarding  the  current  state  of  affairs  within  the  community.  Several 
respondents  suggested  that  a  technical  article  might  be  valuable.  However,  the  CBIAC 
Director  and  CBIAC  COTR  indicated  that  publishing  such  an  article  might  be  difficult  given 
the  information  security  and  export  control  requirements  under  which  the  CBIAC 
Newsletter  was  published. 

We  believe  on  the  basis  of  conversations  with  individual  CBIAC  users  that  it  is 
likely  that  users  of  the  CBIAC  Newsletter  who  were  not  especially  satisfied  with  it  simply 
failed  to  return  questionnaires;  others  who  were  satisfied  may  simply  have  been  too  busy 
to  tell  CBIAC  about  their  use  of  CBIAC  supplied  information. 

2 .  Benefits  of  Individual  Response  Services 

In  order  to  better  understand  how  CBIAC  users  benefit  from  products  and  services 
provided  by  the  IAC  under  its  core  program,  we  sought  out  a  sample  of  individual 
response  services  for  each  IAC  to  be  interviewed  by  telephone  The  sample  was  generated 
by  reviewing  lists  of  CBIAC  technical  inquiries,  bibliographic  inquiries,  and  referrals. 
Telephone  calls  were  placed  to  as  many  named  individuals  3$  could  be  located.  CBIAC 
provided  us  with  a  listing  of  323  users  of  core  services  in  calendar  year  1983.  Of  this 


number,  we  spoke  to  75  users.  Of  the  75,  14  were  able  to  quantify  benefits  to  their 
organizations  either  in  terms  of  time  or  money.  Table  4-3  summarizes  our  efforts  to  contact 
CBIAC  individual  response  core  program  users. 

Tablo  4-3.  CBIAC  Core  Users  Survey-individual  Response  Services  Users 

FY  1986-1988 


lUser  Agency  1 

25 

DoD  Users 

48 

DoD  Contractors 

2 

Commercial  Ventures 

Nature  of  Task 

23 

Annotated/Critical  Bibliographies 

9 

Documents 

7 

General  Information 

39 

Technical  Inquiries 

6 

Referrals 

Funding 

Funded  through  Core  Funds  ($262,000) 

Amount 

of  Quantified  Benefit 

8 

Core  Funded  Tasks  With  User-Quantified  Benefits  Exceeding 
$565,000 

Methods 

Used  to  Quantify  Benefits  by  User3 

Benefits  of  5  tasks  quantified  on  the  basis  of 

(a)  time  or  effort  saved  or 

(b)  costs  of  alternate  source 

Benefits  of  3  tasks  quantified  on  basis  of  savings  resulting  from  not 
having  to  conduct  tests  or  by  making  engineering  change  plans 

The  discussion  that  follows  is  an  overview  of  more  detailed  descriptions  of  each 
interview  found  in  Appendix  D  to  this  report 

(a)  Quantitative  Benefits 

One  user  described  his  savings  as  thousands  of  dollars  and  a  lot  of  time  based  on 
CBIAC  provided  information  about  setting  up  a  data  base.  He  explained  that  if  he  had  to 
do  it  himself,  it  would  have  cost  him  more  in  time  and  money.  In  addition  to  increased 
ADP  costs,  there  would  also  be  a  time  lag  in  procuring  the  equipment 

Another  customer  provided  two  sets  of  figures  as  to  how  much  money  he  saved  by 
going  to  CBIAC.  Appendix  F  lists  the  lower  of  the  two  figures.  He  used  the  information 
provided  to  pursue  a  study  of  threat  agents;  the  bibliography  and  materials/agent  property 
data  that  CBIAC  provided  as  a  free  core  service  was  used  to  narrow  the  avenues  he  needed 
to  pursue.  He  estimated  that  had  he  gone  out  on  contract,  it  would  have  cost  him  at  least 
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$8,000-$  10,000.  If  he  had  done  the  work  himself,  it  would  have  taken  3-4  weeks  to 
complete  at  a  cost  of  $6,000-7,000. 

One  manufacturer  of  optical  displays  for  the  812  aircraft  estimated  that  his  company 
saved  about  $2,000  by  not  having  to  test  its  equipment  based  on  information  provided  by 
CBIAC.  Avoiding  the  requirement  for  testing  also  saved  his  firm  considerable  time. 

Another  manufacturer  had  asked  CBIAC  for  the  effects  of  decontaminants  on 
materials  in  collective  and  personal  protective  systems.  Because  of  the  information  CBIAC 
provide,  the  manufacturer  estimated  a  savings  in  the  range  of  $20,000-$  100,000  in 
comparison  to  the  costs  of  conducting  such  tests  on  its  own.  This  judgment  was  based  on 
an  estimate  of  400  to  2000  labor  hours  of  testing  at  a  burdened  cost  of  $50.00  per  hour 
required  to  obtain  similar  information. 

One  government  employee  had  been  tasked  to  develop  an  evaluation  technique  for 
collective  protection  units  against  biological  agents.  Had  CBIAC  not  been  available  and  a 
competitive  contract  for  research  support  been  required,  he  estimated  that  it  would  have 
taken  nine  months  for  him  to  receive  any  useable  data  and  would  have  cost  at  least 
$20,000  plus  the  costs  of  government  personnel  involved  in  the  procurement  action. 

In  two  cases  considerable  savings  occurred  by  not  having  to  run  tests.  One 
individual  estimated  the  value  of  information  supplied  by  CBIAC  in  lieu  of  running  a  test 
to  be  $40,000.  Another  individual,  who  asked  for  materials  and  agent  property  data  as 
well,  estimated  CBIAC  information  on  the  chemical  resistivity  of  certain  polymeric 
materials  saved  his  company  about  2  years  and  about  $250,000  that  would  have  otherwise 
been  invested  to  obtain  this  information  in  its  own  research  program. 

Another  user  reported  a  dollar  savings  of  $250,000.  The  Army  had  proposed  an 
engineering  change  plan  (ECP)  to  modify  gun  sights.  Based  on  information  that  CBIAC 
provided,  he  and  his  company  were  able  to  convince  the  Army  that  if  was  unnecessary  to 
coat  the  interior  of  gun  sights.  By  not  having  to  perform  the  extra  work,  the  government 
was  able  to  save  money. 

One  user  described  a  $2, COO  savings  to  his  company  based  on  a  bibliography 
provided  by  CBIAC.  When  a  solicitation  for  a  series  of  collapsible  tanks  requiring 
conformance  with  the  chemical/biological  warfare  materiel  survivability  requirement  was 
published,  the  user  asked  CBIAC  if  the  tank  coating  of  urethane  used  in  his  firm's  existing 
products  would  be  responsive  to  the  solicitation.  CBIAC  reported  that  its  analysis  of 
available  information  on  urethane  strongly  suggested  that  it  would  not  be  an  effective 
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coating  in  a  chemical  warfare  environment.  Based  on  this  information  provided  by 
CBIAC,  his  company  did  three  things.  First,  it  chose  not  to  bid  on  the  solicitation  since  the 
products  offered  would  not  be  fully  responsive  to  the  solicitation.  As  a  result,  they  saved 
scarce  B&P  money.  Second,  the  company  became  fully  aware  of  the  chemical/biological 
materiel  survivability  requirement,  of  which  it  had  been  previously  ignorant  This  raised  a 
serious  concern  within  the  company  about  the  long  term  competitiveness  of  its  products. 
Finally,  the  user  did  not  simply  retain  the  information  for  future  reference  or  toss  it  aside 
once  the  company  had  made  the  "no  bid"  decision.  He  forwarded  a  copy  of  the 
information  to  the  DoD  agency  soliciting  the  procurement,  so  that  the  requiring  agency 
might  better  evaluate  the  responsiveness  of  other  firms  presenting  offers.  The  CBIAC  user 
told  us  he  hoped  that,  at  the  very  least,  the  information  provided  by  CBIAC  to  him  and  then 
to  the  government  would  allow  the  contracting  officer  to  make  a  more  informed  decision 
when  he  did  award  a  contract 

Other  users  reported  quantifiable  benefits  based  on  time  and  (one  case)  travel 
savings.  Time  savings  ranged  anywhere  from  3  days  to  1-1/2  years.  In  addition,  time 
savings  were  almost  always  tied  to  a  qualitative  benefit 

At  the  low  end  of  the  time  scale,  one  user  got  a  bibliography  from  CBIAC  which  he 
used  for  background  information.  He  could  have  found  the  information  himself,  but 
believed  that  it  would  have  taken  him  from  3-5  days  to  get  iL 

In  another  case,  savings  of  time  were  especially  notable.  The  CBIAC  user  asked 
for  materials  property  data  and  was  provided  the  necessary  information  within  a  day  as 
opposed  to  the  week  hn  estimated  it  would  have  taken  if  he  had  been  required  to  find  the 
data  himself  from  the  library.  Furthermore,  the  user  figured  the  cost  of  doing  the  work  for 
himself  to  be  $1800  for  40  hours'  worth  of  work. 

A  government  user  reported  that  on  the  basis  of  the  technical  information  and 
referrals  CBIAC  provided  to  him,  he  was  able  to  save  about  a  week’s  time  by  not  having  to 
find  either  the  information  for  himself  or  by  having  to  chase  randomly  after  contacts.  He 
reported  other  qualitative  advantages  of  CBIAC,  which  will  also  be  discussed  below. 

One  customer  used  CBIAC  for  assistance  in  acquiring  information  related  to  the 
development  of  CW  related  software  and  data  bases.  He  estimated  that  if  he  had  to  go 
elsewhere,  it  would  take  2-3  times  longer  to  get  information  for  a  quick  look  study. 
Further,  if  he  had  to  do  the  search  himself,  it  would  take  about  a  month.  However,  he 
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would  not  do  the  search  himself  since  it  would  be  both  impractical  and  inconvenient  for 
him  to  do  so. 

Finally,  one  individual  asked  for  an  analysis  of  Freon  for  use  in  decontamination  of 
LANTTRN  pods.  He  estimated  if  his  activity  had  been  required  to  solicit  a  separate  contract 
for  the  necessary  information,  it  would  have  taken  12-18  months  to  obtain  equivalent 
information  provided  by  CBIAC  in  a  matter  of  a  few  days.  This  user  also  cited  a 
significant,  but  unquantified  benefit  from  the  CBIAC  information.  Freon  used  as  a 
chemical  agent  decontamination  solution  can  be  detrimental  to  the  LANTIRN  pods. 

Twenty-one  CBIAC  users  reported  unquantified  (but  quantifiable)  savings  in  time, 
money,  and  also  in  opportunities.  Of  this  number,  5  reported  savings  in  both  time  and 
money,  6  reported  money  savings,  6  reported  time  savings,  and  4  others  reported  savings 
either  by  value  engineering  p'an  changes,  not  performing  an  unnecessary  test  (2),  or 
recovering  lost  work  which  the  government  had  contracted  but  had  never  received  in  final 
form.  These  are  discussed  in  some  detail  in  Appendix  F.  However,  the  last  case  merits 
additional  attention. 

The  user’s  firm  is  involved  in  the  manufacture  of  remote  sensing  devices.  She  had 
heard  that  sometime  in  the  early  1980s  the  government  had  sponsored  work  on  particulates 
in  a  chemical  battlefield  environment.  This  information  was  particularly  relevant  to  work 
she  was  performing.  Clearly,  if  she  did  not  have  to  go  out  and  regenerate  the  data,  there 
would  be  a  significant  savings  of  time  and  money.  Ideally,  the  data  would  be  in  digital 
form;  but  even  if  it  were  not,  it  was  clearly  better  than  nothing. 

She  reported  that  after  tracking  down  and  contacting  ten  prospective  leads,  none 
had  any  knowledge  of  the  earlier  work  done  for  the  U.S.  government  She  called  CBIAC 
on  the  outside  chance  that  the  staff  might  be  able  to  help  her.  She  reported  that  the  CBIAC 
staff  reported  vital  information  to  her  within  a  day  including  the  name  and  phone  number  of 
the  person  to  whom  she  needed  to  talk. 

The  CBIAC  user  reported  that  she  subsequently  learned  that  the  scientist  collecting 
the  original  data  she  was  seeking  had  left  the  contractor  shortly  before  the  final  contract 
deliverable  (the  data)  was  due.  His  COTR  had  left  shortly  thereafter,  and  no  one  had 
followed  up  on  the  program.  As  a  result,  the  data  had  been  functionally  resident  in  a 
computer  since  1982.  However,  it  was,  for  all  intents  and  purposes,  work  that  the 
government  had  Host”. 
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The  CBIAC  user  was  able  to  make  arrangements  to  obtain  the  data.  The  savings 
were  thus  two-fold.  She  did  not  have  to  generate  already  extant  (but  misplaced)  data,  and 
the  government  was  able  to  recover  work  that  had  been  performed  but  not  delivered. 

In  summary,  CBLAC's  quantified  and/or  quantifiable  benefits  break  into  the 
following  categories.  In  the  quantified  category,  10  reported  saving  money  in  time  and 
effort  and  4  reported  savings  by  engineering  change  plans  or  by  not  having  to  perform 
tests.  Of  the  quantifiable  but  no  quantity  given,  14  reported  savings  of  time  and/or  money 
and  6  reported  savings  by  not  having  to  conduct  unnecessary  tasks  or  by  recovering  lost 
data.  As  mentioned  earlier,  many  of  these  benefits  are  also  tied  to  unquantifiable  but 
defined  benefits  as  well. 

(b)  Qualitative  Benefits 

In  this  phase  of  the  study.  Evaluation  of  DoD  Information  Analysis  Centers 
Program,  several  general  classes  of  qualitative  benefits  provided  by  IACs  were  identified. 
The  benefits  cited  by  users  included  the  following  classes: 

•  Verification  of  information; 

•  Objectivity  and/or  neutral  competence; 

•  Enhanced  productivity; 

•  Tfo.  ability  to  work  to  standards  (in  some  cases,  the  standards  the  IAC  helped 
to  produce); 

•  Enhanced  communication; 

•  Greater  competition;  and 

•  Improved  military  capability. 

In  the  case  of  CBIAC,  core  program  information  consumers  reported  benefits  in 
almost  all  of  these  classes. 

(i)  Verification/Substantiation 

Verification  of  information  does  not  merely  include  an  IACs  stating  that  the 
information  is  correct;  it  includes  enhancing  the  confidence  that  the  questioner  has  about  his 
technique  or  solution.  Verification  includes  substantiation  of  analysis. 

Eleven  CBIAC  users  reported  that  the  IAC  they  had  used  had  provided  significant 
benefit  by  verifying  or  substantiating  data  obtained  from  other  sources.  In  some  cases, 
independent  verification  had  a  quantifiable  benefit. 
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One  CBIAC  user  was  able  to  save  his  sponsor  an  estimateed  $250,000  based  on 
CBIAC-derived  data.  This  user  told  us  that  his  sponsor  was  concerned  that  the  interior  of  a 
gunsight  might  have  to  be  painted  to  provide  protection  against  materiel  contamination  in  a 
toxic  environment.  Data  supplied  by  the  gunsight  manufacturer  suggested  that  the  gunsight 
was  adequately  sealed  against  toxic  vapors  and  would  not  be  contaminated  if  exposed  to  a 
toxic  environment  On  the  basis  of  information  provided  by  CBIAC,  it  was  determined 
that  the  gunsight  manufacturer's  data  was  accurate  and  the  gunsight  interior  would  not  have 
to  be  painted. 

Generally,  CBIAC  users  who  claimed  the  benefit  of  verification  of  existing 
information  told  us  that  CBIAC-data  helped  them  by  supporting  other  analyses.  These 
frequently  were  critical  to  decisions  about  the  need  to  test  systems,  subsystems  or  materials 
for  survivability  in  a  toxic  environment 

(ii)  Absolute  Objectivity 

No  CBIAC  core  users  told  us  that  absolute  objectivity  or  neutral  competence  was  a 
major  benefit  to  them.  This  was  a  surprising  finding  in  light  of  the  great  significance 
attached  to  the  objectivity  of  CBIAC  information  attached  by  special  task  users  described 
below. 


(iii)  Enhanced  Productivity 

CBIAC  also  provided  several  customers  with  general  information  about  chemical/ 
biological  warfare  materiel  survivability  requirements  which  were  credited  with  improving 
productivity  by  its  recipients.  In  one  case,  a  CBIAC  user  transitioned  from  the  nuclear 
survivability  mission  area  into  another  field.  Based  on  information  provided  by  CBIAC  in 
a  series  of  briefings,  he  felt  he  had  learned  the  key  dements  of  the  chemicaj  /biological 
materiel  survivability  requirements  more  quickly  than  if  he  had  tried  to  sit  through  a  series 
of  Army  and  contractor  presentations. 

Finally,  as  noted  above,  one  user  reported  that  CBIAC  made  him  aware  of  a 
potentially  serious  problem  associated  with  decontamination  of  LANTIRN  pods.  Although 
the  results  of  the  CBIAC  study  indicating  Freon  might  be  potentially  damaging  to  the 
system  if  used  as  a  decontaminant,  the  CBIAC  user  told  us  that  no  changes  would  hi  made 
in  the  program.  It  was  too  far  into  production,  at  this  time.  Making  changes  to  correct  the 
materiel  vulnerability  problem  identified  as  a  result  of  the  CBIAC  analysis  would  be 
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prohibitively  expensive.  However,  it  is  beneficial  to  be  aware  of  the  potential  problem  so 
that  future  programs  like  it  can  work  around  it. 

(iv)  Standards  and  Standardization 

Army  Regulation  7071  "Research,  Development,  and  Acquisition:  Nuclear, 
Biological,  and  Chemical  Contamination  Survivability  of  Army  Materiel,"  dated  1  April 
1984,  specifies  general  requirements  for  the  design  and  operation  of  Army  material  in  a 
toxic  environment.  It  has  been  incorporated  in  an  evolutionary  manner  in  Army 
acquisitions  since  1984.  Many  suppliers  of  equipment  to  the  Army  are  only  now  beco.ning 
familiar  with  the  requirements  of  this  regulation.  Our  interviews  found  many 
manufacturers  who  are  eagerly  turning  to  CBIAC  in  order  to  obtain  data  and  advice 
necessary  to  determine  whether  or  not  their  products  meet  the  requirements  of  this 
regulation. 

One  CBIAC  user  told  us  that  CBIAC  was  the  authoritative  voice  for  the  government 
in  terms  of  chemical  and  biological  warfare  materiel  survivability  information.  Other 
CBIAC  users  reported  that  they  had  experienced  difficulty  in  obtaining  information 
regarding  AR  7071,  up  to  and  including  obtaining  a  copy  of  the  Army  Regulation.  These 
users  were  universal  in  their  praise  for  CBIAC's  assistance  in  identifying  and  even 
supplying  on  occasion  copies  of  relevant  directives,  regulations,  and  instructions.  Data  and 
other  information  provided  by  CBIAC  enabled  our  respondents  to  determine  what  tests  if 
any  were  needed  to  determine  whether  or  not  the  products  offered  could  meet  the 
requirements  of  AR  7071.  It  ensured  that  they  would  meet  their  contractual  obligations. 

(v)  Enhanced  Communication 

The  basic  DoD  directive  covering  the  collection  and  dissemination  of  scientific  and 
technical  information,  DoD  Directive  3200.12,  establishes  a  very  ambitious  program  for  the 
communication  of  such  information  between  DoD  components  and  their  contractors.  Many 
core  IAC  users  with  whom  we  spoke  had  high  praise  for  the  technical  conferences  and 
symposia  sponsored  CBIAC  for  identifying  new  developments  or  new  sources  of 
information  that  could  assist  them  in  their  RDT&E  efforts.  While  few  users  could  attach 
dollars  to  the  benefit  of  communicating  more  effectively  with  other  members  of  the  CBW 
community,  many  felt  that  there  was  a  significant  savings  in  time  and  dollars  associated 
with  use  of  CBIAC  as  a  conference  sponsor,  convener,  and  reporter. 
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(vi)  Enhanced  Competitiveness 

Enhanced  competitiveness  means  an  expanded  DoD-related  industrial  base.  The 
Competition  in  Contracting  Act  on  the  one  hand  and  pressures  on  DoD  to  obtain  more 
products  and  services  with  shrinking  resources  on  the  other  have  placed  renewed  emphasis 
on  obtaining  more  "bang  for  the  buck."  Not  only  is  DoD  interested  in  expanding  the  DoD- 
related  industrial  base,  the  application  of  the  Competition  in  Contracting  Act  to  DoD 
contracts  has  encouraged  DoD  vendors  to  expand  their  product  lines  to  remain  competitive. 
DoD  IACs  have  been  helpful  to  the  competitive  processes  in  several  instances  as 
documented  thus  far  in  our  study. 

Two  CBIAC  users  emphasized  the  role  CBIAC  played  in  allowing  them  to  compete 
in  die  market  place.  One  company  is  a  consulting  firm  which  tries  to  match  U.S.  and 
foreign  firms  interested  in  joint  ventures  to  meet  U.S.  military  equipment  needs.  This  user 
went  to  CBIAC  to  find  the  names  of  people  in  the  DoD  and  the  government  who  could 
benefit  from  a  client's  protective  clothing.  The  information  provided  by  CBIAC  enabled 
this  user  to  undertake  a  more  sophisticated  analysis  of  the  DoD  market  for  his  client’s 
protective  ensemble.  He  stated  that  small  business  cannot  afford  to  do  a  lot  of  research. 
He  saw  IACs  as  having  enormous  potential  for  helping  small  and  disadvantaged  businesses 
simply  because  the  IACs  could  provide  them  with  the  various  kinds  of  information  that 
they  needed  more  rapidly  and  cheaply  than  they  themselves  could  do. 

Another  small  business  stated  that  he  used  the  information  provided  by  CBIAC  to 
develop  a  more  effective  marketing  strategy.  Data  collected  by  CBIAC  was  used  to  identify 
a  potential  need;  additional  data  was  collected  from  CBIAC  to  support  additional  marketing 
and  training  efforts  once  a  specific  marketing  objective  had  been  identified.  This  CBIAC 
user  estimated  that  CBLAC's  assistance  had  significantly  reduced  the  amount  of  time  and 
energy  he  had  to  expend  to  identify  and  develop  marketing  opportunities  in  the  chemical 
warfare  mission  area. 

Two  CBIAC  respondents  mentioned  using  the  LAC  as  part  of  the  bidding  process. 
One  entailed  an  enlightened  "no  bid"  decision  already  noted  above.  The  other  involved 
looking  at  a  competitor’s  product  In  this  case  two  manufacturers  produced  similar  fabrics 
using  different  techniques.  The  interviewee's  company  had  chosen  not  to  bid  on  a 
proposal.  However,  its  management  was  curious  to  know  whether  or  not  the  winner  of  the 
contract  had  developed  a  new  manufacturing  process  that  would  essentially  render  the 
CBIAC  user's  firm  uncompetitive  for  the  foreseeable  future.  On  the  basis  of  information 


provided  by  CBIAC,  it  was  determined  that  the  rival  firm  was  using  a  technique  that  had  in 
fact  been  investigated  by  the  CBIAC  user  in  the  past  and  had  been  found  to  be  of  limited 
utility  in  the  manufacture  of  their  product  Thus  the  CBIAC  user's  firm  remains  on  the 
sidelines  of  the  procurement  of  chemical  defense  cloth  at  this  time,  but  is  hopeful  that  it  can 
compete  effectively  at  some  point  in  the  future. 

(vii)  Improved  Military  Capability 

Several  CBIAC  core  users  reported  that  the  use  of  CBIAC  had  impacted  directly  on 
the  military  capabilities  of  U.S.  forces.  For  example,  one  user  relied  on  materials  property 
data  supplied  by  CBIAC  to  recommend  a  new  material  to  be  used  in  litters  to  transport 
casualties.  The  new  material  was  more  resistant  to  chemical  agents  and  stood  up  better  to 
decontamination  agents  should  their  use  be  required.  Another  core  user,  noted  above, 
identified  significant  problems  with  LANTTRN  pods.  Decontamination  efforts  with  current 
equipment  will  cause  serious  degradation  of  capability. 

A  core  user  involved  in  materials  survivability  studies  used  CBIAC  information  to 
assess  the  survivability  of  the  laser  range  finder  integrated  into  the  Commander’s  Integrated 
Display.  CBIAC  data  resulted  in  product  improvements  through  ihe  use  of  chemical  agent 
resistant  materials  and  better  fabrication  processes.  Another  user  relied  upon  CBIAC 
information  to  address  the  issue  of  ATM  effectiveness  against  chemical-agent  missile 
warheads. 

D.  BENEFITS  FROM  SPECIAL  TASKS 
1.  Background 

In  addition  to  building  a  collection  of  information  in  a  specific  discipline  or  mission 
area  and  disseminating  information  and  analysis  based  on  it  for  the  entire  relevant 
community,  DoD  IACs  also  undertake  more  focused  tasks  on  behalf  of  individual 
government  requiring  activities.  Special  tasks  are  undertaken  only  after  the  Technical 
Monitor  and  the  Procuring  Contracting  Officer  evaluate  technical  proposals  to  determine  if 
the  proposed  task  is  within  the  technical  scope  of  the  IACs  contract  and  if  the  IAC  has  the 
necessary  expertise  to  perform  the  task.  It  is  the  core  funding  which  establishes  and 
maintains  the  IACs  capability  to  provide  products  and  services  of  value  to  the  users. 

The  decision  to  use  an  IAC  to  perform  a  special  task  is,  from  the  point  of  view  of 
the  Special  Task  requiring  activity,  a  free  market  decision.  As  we  were  able  to  document  in 
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this  phase  of  our  study,  most  IAC  special  task  users  have  a  variety  of  procurement 
instruments  available,  including  full  and  open  competition  for  research  and  development 
contracts,  open  task  order  contracts  for  mission  support  services,  technical  services,  base 
support,  etc.  A  decision  to  use  a  DoD  IAC  suggests  that  the  requiring  activity  has 
determined,  ipso  facto,  that  IAC  products  and  services  are  worth  more  than  they  cost. 
While  that  is  a  rather  simplistic  assumption,  it  does  establish  a  different  sort  of  lower  bound 
for  benefit  valuation-benefits  may  be  postulated  as  always  equaling  or  exceeding  costs. 

In  this  analysis  we  sought  the  user's  evaluation.  Those  evaluations  took  several 
forms,  from  the  most  conservative  (how  much  would  the  same  amount  of  effort  cost  in- 
house  and  what  is  the  comparable  quality)  to  the  most  extravagant  (what  was  the  total  cost 
versus  the  total  benefit  of  the  experiment  in  which  the  IAC  was  participating). 

All  of  these  estimates  are  more  or  less  objective:  none  is  completely  objective 
because,  in  every  case,  the  actual  cost  must  inevitably  be  compared  to  the  cost  of  something 
not  done-and  insofar  as  it  was  not  done,  its  estimated  cost  must  be  subjective. 

Our  methodology  was  quite  simple  and  straightforward.  We  examined  the  list  of 
special  tasks  provided  by  CBIAC  to  determine  whether  there  were  either  individual  heavy 
users  of  each  IAC  or  geographic  concentrations  of  heavy  users.  We  found  that  we  could 
cover  most  of  the  users  with  only  a  few  trips.  Utilizing  a  questionnaire  to  provide  a 
framework  for  data  collection,  we  conducted  more  than  30  interviews  with  special  task 
users  of  CBIAC  (see  Table  4-4).  The  purpose  of  these  interviews  was  to  understand  the 
process  by  which  special  task  users  selected  CBIAC  to  perform  a  task,  completed  the 
procurement  of  the  task,  and  evaluated  the  benefits  of  the  work  performed  by  an  IAC  for 
their  program.  It  should  be  further  noted  that  the  interviews  were  not  constrained  in  any 
manner  by  the  questionnaire. 

Tablo  4-4.  Sample  IAC  Special  Task  Users  by  Military  Service 


Service 

#  of  Tasks 

Air  F  tree 

10 

Army 

28 

Naw/Marines 

11 

oso 

1 

Other  USG 

1 

Total  Peculation 

51 

© 
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We  were  able  to  collect  data  through  interviews  on  32  CBIAC  tasks20  undertaken 
during  FY  1987  and  FY  1988.  Data  was  collected  through  hour-long  interviews  followed 
up  from  time  to  time  by  additional  telephone  conversations  or  correspondence.  Table  4-5 
captures  the  degree  to  which  our  study  was  able  to  cover  the  special  tasks  undertaken  by 
each  IAC. 


Table  4-5.  Coverage  of  Special  Task3  by  Representative  Sample  Study 


Air  Force 

Army 

Navy 

Tasks 

Dollars 

Tasks 

Dollars 

Tasks 

Dollars 

CBIAC 

100% 

100% 

83% 

42% 

59% 

As  this  table  indicates,  our  efforts  to  cover  a  broad  sample  of  special  task  users  of 
CBIAC  was  reasonably  successful.  As  much  success  was  achieved  in  large  part  because 
CBIAC  is  a  young  IAC  and  most  of  the  initial  special  task  users  are  still  at  the  assignment 
at  which  they  were  serving  when  they  placed  their  task  order. 

An  issue  arose  during  the  pilot  study  regarding  the  kinds  of  funds  being  spent  at 
DoD  LACs.  In  the  case  of  CBIAC,  we  were  fairly  fortunate  in  identifying  the  various  kinds 
of  RDT&E,  O&M,  and  Procurement  funds  being  expended  to  pay  for  special  studies  and 
tasks.  The  data  follows  in  Table  4-6. 

Tabla  4-6,  Budget  Categories*  of  Special  Studies  Performed  by  CBIAC 


Budqet  Category 

AF 

CBIAC 

AR 

N 

Unknown 

3 

10 

4 

6.1 

4 

6.2 

11 

6.3A 

3 

10 

2 

R.3B 

1 

2 

6.4 

4 

06M 

Procurement 

1 

'  This  table  treats  each  accurror.ce  of  a  budget  category  as  a  discrete 
sourco  of  funds  even  though  there  are  several  instances  in  which  funds 
from  multiple  budget  categories  are  u 3*d  to  support  one  task. 


20  For  purposes  of  simplifying  travel  planning  and  analysis  of  data,  we  have  treated  multipnase  special 
tasks  conducted  for  the  same  requiring  activity  as  one  task  even  though  the  LACs  will  report  each  phase 
as  a  separate  task.  As  a  result,  we  understate  by  a  small  margin  the  number  of  tasks  actually  reviewed 
for  each  IAC  covered  in  this  report  in  comparison  with  the  number  of  tasks  reported  by  the  IAC 
Program  Office  at  DTIC. 
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It  is  also  worth  noting  that  the  CBIAC  Director  and  the  CBIAC  Technical  Monitor 
(COTR)  are  generally  unaware  of  or  uncertain  about  the  category  of  funds  being  expended 
at  CBIAC  in  the  procurement  of  special  studies.  The  CBIAC  Director  and  CBIAC 
Technical  Monitor  believe  their  activities  support  the  entire  acquisition  community,  not 
merely  the  research  and  development  phase  of  the  acquisition  process.  As  a  result,  we 
were  able  to  identify  the  category  of  funds  being  used  to  procure  a  special  task  only  by 
talking  with  the  special  task  requiring  activity. 

2 .  Benefits  Discussion:  Overview 

IDA  was  asked  early  in  the  course  of  this  task  to  construct  a  benefit-cost  ratio  if  at 
all  feasible.  The  aggregate  data  presented  in  Table  4-7  below  allows  for  the  coarse 
calculation  of  such  a  benefit-cost  ratio  for  CBIAC.  If  one  assumes  that  the  full  cost  of  the 
special  task  was  the  cost  paid  by  the  requiring  activity  to  CBIAC,  then  the  data  below 
suggest  that  CBIAC  special  tasks  have  a  benefit-cost  ratio  in  aggregate  of  approximately 
3.5  to  1.  This  ratio  is  derived  from  dividing  the  quantified  benefits  of  $1.4  million  from  5 
special  tasks  by  the  $431,000  cost  of  the  tasks. 

Tabta  4-7.  Quantitative  Benefits  Prom  Selected  DOD  lACs 


IAC 

#  of  Tasks 
with  Bsnsflt 

Data 

Total  Cost  of 
Banaflt  Data 
Tasks 

Quantified 

Value  of 
Benefits 

Benefit  Calculation 
Method 

#  o J  Tasks 
Quantlflad 
Bonoflts 

Cost  of 
Quantified 
Benefits  Tasks 

CBIAC 

32 

$4,268,000 

$1,407,500 

LOWER  LABOR  RATES 

DEFERRED  PROCUREMENT 

5 

$431,000 

iVe  also  found  several  IAC  special  task  users  who  described  the  results  of  IAC 
special  tasks  in  terms  that  lead  us  to  believe  at  some  future  point  in  time  it  will  be  possible 
to  quantify  the  benefits  of  the  IAC  work;  it  is  not  possible  to  do  so  at  this  time.  Finally,  we 
found  several  IAC  users  who  told  us  of  benefits  that  had  been  received  from  the  work 
performed  by  an  IAC  which  were  important  to  their  programs  but  could  not  now  be 
quantified,  nor  was  it  ever  likely  that  such  benefits  would  be  quantifiable. 


Table  4-8  summarizes  the  results  of  our  efforts  to  categorize  the  benefits  reported 
by  special  task  users  of  CBIAC  in  terms  of  quantified,  quantifiable,  defined  and  undefined 
benefits.  As  the  table  makes  clear,  most  special  task  users  with  whom  we  spoke  were  able 
to  define  the  benefits  of  IAC  special  tasks  for  their  research  and  engineering  programs;  they 
were  frequently  able  to  define  the  benefits  of  special  tasks  in  terms  that  might  permit 
quantification  of  benefit  in  terms  of  dollars  saved  or  hours  saved  at  some  future  point  in 
time.  Several  users  reported  benefits  that  might  at  some  future  point  be  reported  in  terms  of 
improved  performance  of  military  personnel  as  measured  by  standard  training  techniques. 
However,  unlike  the  pilot  study  of  NTLAC,  we  report  only  one  instance  of  quantifiable 
benefits  obtained  for  each  IAC  included  in  this  phase  of  our  study. 

Table  4-8.  Benefit  Categories  Reported  by  Special  Task  Users  of  CBIAC* 


Benefit  Type 

CBIAC 

Not  known 

Quantified 

5 

Quantifiable  but  no  data  available 

16 

Defined  but  not  quantifiable 

31 

Not  defined 

1 

*  Benefit  categories  reported  include  multiple  benefit 
categories  per  task  where  seme  tasks  had  benefits  which 
could  be  quantified  but  had  not  been  and  also  included 
benefits  which  could  be  defined  but  could  not  be  quantified. 

It  should  be  noted  further  that  several  users  reported  benefits  that  were  both 
quantifiable  as  well  as  defined  but  not  quantified— e.g.,  future  improvements  military 
personnel  performance  in  training  (quantifiable)  and  enhancement  of  deterrence  (not 
quantifiable). 

The  overall  results  of  our  investigation  stand  in  marked  contrast  with  the  results  of 
the  pilot  study  in  which  we  found  a  substantial  number  of  cases  in  which  special  task  users 
were  able  to  quantify  the  benefits  they  received  from  using  the  services  of  NTIAC.  On  the 
other  hand,  the  value  of  the  benefits  attributed  to  these  four  users  who  can  report 
quantifiable  benefits  is  more  than  sufficient  to  cover  the  costs  of  the  entire  LAC  program, 
even  when  heavily  discounted  due  to  the  uncertainties  of  partitioning  variance  in  benefits 
among  all  those  individuals  rnd  organizations  outside  the  IAC  that  might  have  contributed 
to  the  creation  of  such  benefits. 
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3.  Quantitative  Benefits  Assessment 

Table  4-9  summarizes  all  special  tasks  undertaken  by  CBIAC  for  which  we  were 
able  to  determine  quantitative  benefits.  We  were  able  to  identify  a  total  of  33  special  tasks 
undertaken  by  CBIAC  since  the  inception  of  its  contract.  We  were  able  to  obtain  data 
regarding  the  benefits  of  31  special  tasks.  Six  tasks  undertaken  by  CBIAC  with  a  total 
contract  cost  of  $849,643  resulted  in  benefits  which  can  be  quantified  at  not  less  than 
$1,407,500.  One  of  these  tasks  had  an  upper  bound  of  more  than  $6  million  suggested  by 
the  user,  we  believe  CBIAC  should  be  credited  'with  a  fraction  of  that  amount.  We  were 
not  able  to  devise  a  method  to  partition  the  value  among  the  government  personnel,  other 
consultants,  and  the  CBIAC  effort 

In  one  special  task  CBIAC  undertook  an  analysis  of  requirements  for  the  operation 
of  a  network  of  laboratories  which  could  pool  data  collected  to  support  analysis  and 
assessment  of  potential  chemical  agents.  The  benefits  identified  by  CRDEC  were  valued  at 
$225,000.  Another  CRDEC  task  examining  methods  of  collective  protection  for  armored 
vehicles  yielded  a  small  benefit  measured  in  terms  of  dollars  but  a  very  large  benefit  in 
terms  of  operational  capability. 

In  another  CBIAC  task,  an  assessment  of  the  effectiveness  of  an  alternative  concept 
for  the  operation  of  armored  vehicles  in  low-level  contaminated  environments  was 
undertaken.  Thus  task  resulted  in  verification  of  a  design,  proof  of  concept,  improved 
training,  and  a  small  quantified  benefit  to  the  government  in  excess  of  $5,000  based  on 
lov/cr  costs  of  CBIAC  personnel  compared  to  government  personnel.  It  was  emphasized 
by  the  special  task  user  that  from  his  perspective,  the  IDA  study  was  essentially  dividing 
the  benefits  of  CBIAC  by  zero  because  although  CBIAC  staff  were  less  costly  than  U.S. 
Government  personnel,  no  government  personnel  were  available  to  perform  the  work 
necessary  to  resolve  the  technical  question  of  armcr  vehicle  operation  in  a  low-level 
chemical  contaminated  environment  If  CBIAC  did  not  exist  the  study  which  had 
significant  qualitative  benefits  would  simply  not  have  been  performed 

The  USDA  office  in  Sacramento  commissioned  a  $20,000  task  to  complete  work 
initiated  by  another  contractor  for  about  $60,000  that  was  net  adequate.  The  results  of  the 
CBIAC  work  were  very  satisfactory,  and  were  deemed  equivalent  to  the  work  undertaken 
by  the  other  contractor.  EDA  valued  the  benefit  of  this  task  at  $60,000. 


The  Air  Force  asked  CBIAC  to  undertake  a  study  which  would  be  used  to  qualify  a 
device  proposed  to  measure  the  adequacy  of  fit  of  gas  masks  for  Air  Force  personnel.  The 
objective  of  the  program  was  to  use  the  device  to  reduce  uncertainty  of  fit  resulting  from 
human  measurement  of  gas  mask  fit  The  CBIAC  study  demonstrated  that  the  device  was 
not  capable  of  adequately  measuring  gas  mask  fit.  As  a  result,  the  Air  Force  deferred 
procurement  indefinitely,  saving  at  least  a  million  dollars  for  an  indefinite  period. 
Furthermore,  the  Air  Force  also  learned  that  the  training  program  for  donning  and  use  of 
gas  masks  was  highly  ineffective.  This  caused  a  change  to  be  made  in  gas  mask  training  as 
well. 

CRDEC  established  a  library  to  support  the  Chemical  Demilitarization  Program 
Office  (CHEM  DEMIL)  office.  CBIAC  operated  a  very  specific  information  center/service 
based  on  its  expertise  in  the  field  and  in  the  ability  to  collect  and  manage  specialized 
information.  CBIAC  took  over  from  another  contractor.  The  special  task  monitor 
estimated  that  CBIAC  staff  had  made  3  times  the  amount  of  information  available  to  users 
of  the  special  library  as  the  previous  contractor  for  about  two-thirds  the  cost.  IDA 
estimates  that  the  dollar  value  of  the  benefit  to  CRDEC  resulting  from  this  task  is 
$100,000. 

4.  Qualitative  Benefits  Assessment 

As  in  the  case  of  the  pilot  study  of  NTIAC,  we  found  many  special  task  users  of 
CBIAC  unable  or  only  partially  able  to  quantify  the  benefits  they  received  from  using  a 
DoD  IAC.  On  the  other  hand,  these  users  were  able  to  describe  other  contributions  of  the 
work  performed  by  IACs  included  in  our  study  which  are  of  special  significance  to  DoD, 
even  if  the  benefits  cannot  be  quantified  in  a  direct  or  meaningful  way.  Table  4-10 
summarizes  the  description  of  the  qualitative  benefits  accruing  to  special  task  users  of 
CBIAC.  In  several  instances,  tasks  previously  described  as  having  quantifiable  benefits 
also  had  qualitative  benefits  of  note. 

The  following  is  a  more  detailed  discussion  of  some  of  the  special  task  qualitative 
benefits  reported  by  CBIAC  users. 

(a)  Improved  Military  Capability 

CBIAC  special  task  users  also  reported  direct  impact  on  combat  capability  and 
readiness  as  a  result  of  CBIAC  studies.  Several  Air  Force  users  identified  CBIAC  studies 
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TABLE  4-10:  Qualitative  Benefits  of  Selected  CBIAC  Special  Tasks 
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on  air  base  operability  and  a  detailed  case  study  of  one  very  important  air  base  as 
contributing  significantly  to  changes  in  the  Air  Force  doctrine  of  wartime  air  base 
operations.  Other  CBIAC  studies  have  resulted  in  development  and  acquisition  of 
improved  agent  detectors,  improved  agent  detector  data  integration  and  analysis,  improved 
tank  hatch  covers  for  operations  in  low  level  contamination,  and  successful  evaluation  of 
foreign  chemical  defense  material  for  potential  incorporation  into  U.S.  forces. 

Other  CBIAC  studies  have  resulted  in  major  changes  to  the  manner  in  which  Navy 
and  Air  Force  personnel  are  trained  to  operate  in  toxic  environments.  One  CBIAC  study 
also  resulted  in  the  deferral  of  an  acquisition  of  a  piece  of  equipment  to  test  gas  mask  fit  on 
Air  Force  personnel.  The  study  demonstrated  that  the  piece  of  equipment  was  not  capable 
of  satisfying  the  requirement;  furthermore,  the  study  demonstrated  to  the  Air  Force  that  its 
training  on  the  use  of  gas  masks  was  ineffective. 

(b)  Objectivity  and  Neutral  Competence 

In  our  pilot  study,  we  noted  that  sometimes  it  was  as  important  to  get  an  answer 
from  an  organization  acknowledged  to  be  a  disinterested  expert  as  it  was  to  get  an  answer. 
Our  representative  sample  study  found  several  examples  of  this  benefit  as  well. 

The  existence  of  CBIAC  has  played  an  especially  prominent  role  in  its  selection  for 
several  special  tasks.  In  one  case,  the  Army  and  a  civil  plaintiff  were  able  to  reach  an  out- 
of-court  settlement  over  the  adequacy  of  the  Army's  compliance  with  the  National 
Environmental  Protection  Act  based  on  a  CBIAC  analysis  of  environmental  impact 
requirements  for  the  Army’s  Biological  Defense  Program.  In  other  instances,  CBIAC  has 
undertaken  an  independent  review  and  evaluation  of  architect  and  engineer  drawings  and 
plans  for  new  facilities  at  the  Edgewood  Area  of  Aberdeen  Proving  Ground.  The  purpose 
of  the  review  was  to  advise  the  Chemical  Research,  Development,  and  Engineering 
Command  on  the  adequacy  of  industrial  hygiene  and  environmental  protection  in  the 
proposed  facilities.  CBIAC  was  selected  to  provide  such  advice  because  it  was  perceived 
as  having  both  the  capability  on  the  one  hand,  and  the  independence  and  stature  on  the 
other,  needed  to  fend  off  complaints  or  Congressional  concerns  about  the  adequacy  of 
environmental  and  industrial  hygiene  reviews  conducted  solely  within  the  Army. 

(c)  Enhanced  Productivity 

One  CBIAC  user  has  gained  such  confidence  in  the  quality  of  CBIACs  work  that 
he  no  longer  undertakes  or  permits  members  of  his  staff  to  undertake  any  study  without 
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first  consulting  CBIAC.  This  user  told  us  that  he  had  been  able  to  save  hundreds  of  man¬ 
hours  that  would  have  been  devoted  to  merely  identifying  the  existing  record;  furthermore, 
CBIAC  staff  were  able  to  point  him  and  his  colleagues  in  more  useful  directions.  The  gain 
in  productivity  occurred  not  only  because  of  hours  saved  but  in  terms  of  better  questions 
being  asked,  more  sophisticated  analyses  of  existing  data,  and  more  focused  collection  of 
new  data. 

CBIAC,  too,  has  played  a  major  role  in  improving  test  methodology,  protocols, 
and  operating  procedures  for  the  Army  and  the  Navy.  Several  CRDEC  staff  identified 
improvements  in  test  methods  as  the  most  significant  benefit  of  the  use  of  CBIAC. 

The  Naval  Sea  Systems  Command  has  made  extensive  use  of  CBIAC  to  identify 
strengths  and  deficiencies  in  the  Navy's  NBC  research  program. 

(d)  Standards  and  Standardization 

Each  of  the  LACs  examined  in  this  study  participates  in  the  establishment  of  either 
de  jure  or  de  facto  standards  for  the  Department  of  Defense. 

CBIAC  has  become  the  keeper  of  technical  information  needed  by  the  Army  and  its 
contractors  to  identify  materials  which  do  not  meet,  which  meet,  or  which  exceed 
performance  specifications  for  survivability  in  a  toxic  environment.  As  a  result  of  the 
effective  development  of  a  data  base  on  materials  properties,  CBIAC  is  becoming  the  de 
facto  keeper  of  the  Army's  standard.  In  addition,  other  services  are  relying  on  the  Army's 
standard  for  NBC  survivability  absent  their  own. 

E.  OTHER  USERS  AND  OTHER  BENEFITS 

The  preceding  two  sections  have  presented  the  information  we  have  been  able  to 
collect  about  and  from  identified  core  and  special  task  users  of  CBIAC.  The  discussions  in 
those  two  sections  have  tended  to  focus  on  those  users'  quantifications  of  benefits.  It  is 
important  to  recognize  that  there  are  still  other  users  and  other  benefits  of  work  performed 
by  CBIAC. 

1 .  Users  in  DoD  Programs 

The  DoD  LAC  program  has  been  established  "in  recognition  of  the  important  and 
integral  part  that  information  analysis  and  evaluation  activities  play  in  the  research  and 
development  process...."  Each  technology  thrust  area  will  generally  fail  under  the 
oversight  of  a  technical  program  manager  within  the  DR&E  staff.  That  staff  member  will 
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have  Service  counterparts  who  oversee  the  Service  programs  in  the  thrust  area.  Each  of  the 
Services  may  have  laboratories  or  other  field  agencies  actively  engaged  in  work  in  the 
thrust  area.  In  a  sense,  this  RDT&E  program  chain  is  or  should  be  the  primary  source  of 
users  of  the  IACs  in  their  respective  thrust  areas. 

In  the  case  of  CEIAC,  the  R&AT  staff  share  considerable  responsibility  with  the 
Assistant  to  the  Secretary  of  Defense  for  Chemical  Matters,  a  member  of  the  staff  of  the 
Assistant  to  the  Secretary  of  Defense  for  Atomic  Energy.  During  the  period  FY  1986- 
FY  1988,  the  R&AT  staff  relied  heavily  upon  CBLAC  for  information  vital  to  the  day-to- 
day  oversight  of  the  chemical  and  biological  defense  program.  Since  1988,  much  of  the 
information  formerly  shared  b>  CBIAC  with  DDDR&E/R&AT  has  been  directed  to  the 
Office  of  the  Assistant  to  the  Secretary  for  Chemical  Matters.  The  CBIAC  staff  was  very 
helpful  to  the  R&AT  staff  during  the  period  1987-1988  in  collecting  and  processing 
information  needed  to  respond  to  inquiries  from  the  Congress  about  the  scope  and  direction 
of  American  chemical  warfare  and  biological  defense  programs. 

2.  Other  Users  Beyond  the  Identified  Specific  IAC  Communities 

There  are  those  not  working  in  the  field  of  chemical  warfare  and  biological  defense 
who  also  benefit  indirectly  from  the  DoD  IAC  Program.  CBIAC  reviews  and  reports  on 
architectural  plans  for  certain  facilities  at  the  Edgewood  Area  of  Aberdeen  Proving  Grounds 
have  heightened  awareness  of  architectural  approaches  to  minimizing  adverse 
environmental  impact  of  toxic  or  hazardous  materials  used  in  the  manufacture  of 
pharmaceuticals,  semiconductors,  and  other  industrial  processes  relying  on  toxic  or 
hazardous  reagents.  These  reports  have  use  and  value  far  beyond  those  in  the  DoD 
community  working  with  chemical  warfare  substances  or  biological  defense  technologies. 
CBIAC  tasks  dealing  with  mitigation  of  environmenta'  impact  of  smoke  and  obscurants, 
the  use  of  biological  organisms  to  detect  the  presence  of  toxic  materials  in  water,  and  the 
proper  use  of  gas  masks  in  the  Navy  have  analogous  applications  in  the  civil  sector.  These 
reports  may  lead  to  important  transfer  of  technology  from  the  Federal  to  the  private  sector. 

F,  SUMMARY 

We  have  been  able  to  quantify  the  benefits  to  DoD  of  several  special  tasks 
performed  at  CBIAC.  Significant  quantitative  and  qualitative  benefits  resulted  from  the  use 
of  CBIAC  core  program  information  products  and  services.  Eight  core  technical  inquiries 
from  users  resulted  in  benefits  valued  in  excess  of  $850,000.  Some  seventy-five  CBIAC 


core  users  seeking  answers  to  technical  inquiries,  bibliographic  information,  or  referrals 
provided  us  information  regarding  qualitative  benefits  resulting  from  CBIAC  use  which  are 
summarized  in  Table  4-11. 

Table  4-11.  Qualitative  Benefits  from  CBIAC  Core  Information 
Products  and  Services* 


Qualitative  Benefit  , 

#  of  Tasks 

Reporting  Benefit 

No  Defined  Qualitative  Benefit 

11 

Verification/Substantiation 

22 

Objectivity  SNeutral  Competence 

9 

Enhanced  Productivity 

44 

Standards  and  Standardization 

6 

Enhanced  Communication 

4 

Enhanced  Competitiveness 

8 

Enhanced  Military  Capability 

7 

*  Tho  total  number  of  benefit  types  reported  exceeds  sample  size  due 
to  multiple  benefit  types  for  several  tasks. 


Table  4-12  reiterates  information  presented  in  Table  4-7  above.  While  we  have 
only  a  small  amount  of  quantitative  data  documenting  the  dollar  value  of  benefits  provided 
by  the  representative  sample  IACS,  we  see  that  in  aggregate,  the  dollar  savings  associated 
with  three  DoD  IACs  appear  to  exceed  the  annual  appropriation  for  the  entire  IAC  program 
funded  out  of  the  DLA  R&D  appropriation  line. 


Table  4*12.  Quantitative  Benefits  From  Selected  DOD  lACs 


IAC 

#  of  Tasks 
with  Benefit 
Data 

Total  Cost  of 
Benefit  Data 
Tasks 

Quantified 

Value  of 
Benefits 

Benefit  Calculation 
Method 

#  of  Tasks 
Quantified 
Benefits 

Cost  of 
Quantified 
Benefits  Tasks 

CBIAC 

32 

$4,268,000 

$1,407,500 

LOWER  LABOR  RATES 

DEFERRED  PROCUREMENT 

5 

$431,000 

In  addition  to  the  quantitative  benefits  from  special  tasks  discussed  above,  there 
were  several  significant  qualitative  benefits  to  DoD  resulting  from  the  use  of  CBIAC. 
These  are  summarized  in  Table  4-13. 


Table  4-13.  Quantitative  Benefits  of  Selected  IAC  Special  Task3 


IAC 

QUALITATIVE  BENEFIT 

EXAMPLE 

CBIAC 

IMPROVED  CAPABILITY 

AIR  FORCE  BASE  DEFENSE 

AIR  BmSE  OPERABILITY 

ARMY  CW  DETECTORS 

TANK  CREW  PROTECTION 

IMPROVED  TRAINING 

NAVY  CW  TRAINING 

AIR  FORCE  MASK  TRAINING 

IMPROVED  R&D  PLANNING 

NAVY  CW/BW  6.2  PROGRAM 

ARMY  CHEMICAL  DEMIL  PROGRAM 

CHEMICAL  WARFARE  STUDIES 

IMPROVED  TESTING 

BIOLOGICAL  DETECTION 

SMOKE  AND  OBSCURANTS  PROGRAM 

AIR  FORCE  MASK  PROGRAM 

NEUTRAL  COMPETENCE 

EDGEWOCD  A&E  REVIEW 

BIOLOGICAL  DEFENSE  PROGRAM  EIS 

On  the  basis  of  our  review,  it  appears  that  CBIAC  is  providing  to  DoD  and  its 
contractors  substantial  benefits.  It  appears  that  CBIAC  has  a  benefit-cost  ratio  for  special 
studies  and  tasks  in  the  range  of  3  to  1  for  those  tasks  where  meaningful  cost  and  benefit 
data  were  available. 
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5.  BENEFITS  FROM  GACIAC 


A.  INTRODUCTION 

The  Tactical  Weapons  Guidance  and  Control  Information  Analysis  Center 
(GACIAC),  operated  by  IIT  Research  Institute,  is  a  repository  for  information  relating  to 
sensors,  propulsion,  navigation,  and  munitions  included  in  precision  guided  munitions.  It 
also  holds  information  on  guided  munitions  effectiveness.  GACIAC  includes  in  its 
collection  information  on  platforms  which  carry  precision  guided  munitions,  as  well. 
GACIAC  maintains  an  extensive  library  of  computer  models  for  simulation  and  analysis  of 
guided  munitions  performance.  These  models  are  useful  throughout  design,  development, 
test,  and  modification  of  precision  guided  munitions.  GACIAC  has  some  laboratory 
capability  and  is  used  to  investigate  applications  of  new  materials  to  problems  in  the  field  of 
precision  guided  munitions.  GACIAC  has  also  been  used  to  conduct  "hardware  in  the 
loop"  simulations  related  to  precision  guided  munitions  and  their  integration  with  delivery 
systems. 

GACIAC  provides  the  Defense  Technical  Information  Center  (DTIC)  with  its  data 
base  of  reports,  many  of  which  are  already  included  in  the  DTIC  Reports  Data  Base.  DTIC 
users  have  access  to  the  GACIAC  file  via  the  Defense  Research  On-Line  System  (DROLS), 
provided  that  they  know  to  ask  for  it.  GACIAC  also  publishes  and  performs  primary 
dissemination  its  own  reports. 

Table  5-1  summarizes  GACIAC  funding  for  the  period  FY  1985-FY  1988.  This 
chart  again  places  the  size  and  magnitude  of  GACIAC  core  and  special  task  programs  in 
perspective.  > .. 

The  core  funds  provided  to  GACIAC  by  DLA  in  conjunction  with  additional  funds 
provided  by  the  services  supports  a  small  core  staff  of  the  GACIAC  Director,  two  or  three 
professional  staff  members,  two  or  three  information  specialists,  and  a  handful  of  clerical 
staff.  The  exact  numbers  of  staff  supported  by  the  core  funds  plus  service  funds  varies 
from  year  to  year.  The  special  studies  program  at  GACIAC  supports  a  very  substantial 
number  of  research  and  technical  staff  at  IIT  Research  Institute.  The  number  of  full-time 
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equivalent  positions  varies  considerably  each  year  depending  upon  the  nature  of  the  tasks  to 
be  performed. 


Table  5-1.  GACIAC  Funding  FY  1986-FY  1989 


Fiscal  Year 

DLA  Core 
Funding 

Additional 
Funding  by 
Services* 

Special 

Tasks 

Product 

Sales" 

TOTAL 

1985 

$390,000 

$50,000 

$2,274,618 

$15,675 

$2,730,293 

1986 

$140,000 

$50,000 

$2,746,000 

$38,100 

$2,972,100 

1987 

$274,000 

$250,000 

$4,086,500 

$12,190 

$4,622,690 

1988 

$326,000 

$737,602 

$3,715,935 

$12,200 

$4,841,737 

1S39 

$185,000 

$691,025 

$6,693,177 

$94,163 

$7,663,365  | 

*  Includes  both  additional  core  funding  and  "block  funding*  (special  tasks  for  products  and  services 
subsequently  included  in  the  IAC  core  program)  by  military  services. 

**  Includes  conference  registration  fees  as  well  as  sales  of  information  products  and  subscriptions  to 
GACIAC  services. 

GACIAC  occupies  a  position  of  special  importance  to  the  DoD  conventional 
warfare  community.  GACIAC  is  both  an  IAC  and  a  chartered  ex  officio  member  of  the 
Joint  Service  Committee  on  Guidance  and  Control  (JSGCC)  .  Not  only  does  GACIAC 
perform  all  the  functions  assigned  by  regulation  to  a  DoD  IAC,  it  also  performs  executive 
secretariate  functions  to  the  JSGCC  as  directed  by  DoD  Instruction  5154.26.21  The  Joint 
Steering  Committee  on  Guidance  and  Control  has  provided  considerable  financial 
assistance  to  GACIAC  in  recognition  of  its  role  as  the  executive  secretariate  to  the  JSCGC 
in  recent  years.  The  GACIAC  COTR  has  been  successful  in  persuading  JSCGC  members 
to  provide  funds  in  lieu  of  funds  promised  in  the  DLA  contract  but  not  provided  under  the 
DLA  appropriation  because  of  the  central  role  GACIAC  plays  in  the  planning, 
programming,  ard  program  evaluation  efforts  of  the  JSCGC 

B.  CORE  PROGRAM  DESCRIPTION 

GACIAC  provides  core  services  to  its  user  community  in  two  categories:  general 
distribution  information  items  and  individual  response  items.  During  the  period  for  which 
we  examined  GACIAC  information  products  and  services,  it  published  a  long  list  of 
documents,  reports,  and  current  awareness  products  available  to  qualified  users  with 
appropriate  cleaiances  and  need  to  know.  Table  5-2  lists  these  items. 


2 1  DoD  Instruction  5154.26,  'Joint  Service  Guidance  and  Control  Committee  (JSGCC).' 


Tabla  5-2.  GAC1AC  Cora  Products,  1985-1388 


Introduction  to  Precision  Guided  Munitions 
Properties  ot  Optical  Materials 
Phase  Transition  of  Sulfides,  Selenides,  and  Teliurides 
Potarimetric  Padar  Technology  Workshop,  Volume  1 

Proceedings  of  the  Symposium  on  Target  Acquisition  and  Stnke-Tho  Seeker  Design  Program 
Second  Workshop  on  Polarimetric  Radar  Technology,  Volume  1 

Proceedings  of  the  1985  Prodicibility  of  Mil,,  .eter  Wavelength  Monolithic  Integrated  Circuits 

Proceedings  of  the  Workshop  on  Automation  and  Robotics  for  Military  Applications 

Review  of  Electro-Optic  System  Vulnerability  to  Laser  Radar 

High  Power  Millimeter  Wavelength  Tubes  and  Lasers 

Cha-actertza.ion  of  RF  Sensors/Seekers 

Focal  Plane  Arrays 

Anti-Tactical  Missile  Guidance  and  Control  Technology 
Vanadium  Oxide  Coatings  and  Their  Uses 

State-of-the-Art  Review:  Review  of  Microwave  and  Millimeter  Wave  Monolithic  Integrated  Circuits 
Tri-Service  Seeker  Technology  Tasks,  Second  Edition 
Domestic  Technology 
Sacnfidal  Finer 

Precision  Guided  Munitions  Technology  Topical  Review 
A  Survey  of  Radar  Clutter  Measuring  Data 

Proceedings  of  the  Workshop  on  Radar  Absorbing  and  Armor  Composite  Materials 

Proceedings  of  Military  Applications  of  Electro- Acousto-Optic  (EAO)  Technology  Conference 

1986  Producifcility  of  Millimeter  WavelergtlVMicfOwave  Length  Integrated  Circuits  Conference 

Millimeter  WaveiengttVMicrcwave  Length  Measurements  and  Standards  for  Miniaturized  Systems 
Conference,  1986 

State-of-the-Art  Review:  Cryogenic  Cooling  of  Infrared  Electronics 
Small  Munitions  Primer  and  Briefing  Manual 


GACIAC  provides  a  wide  range  of  information  products  based  on  its  core  program 
on  and  individual  response  basis.  Among  the  services  provided  in  this  category  are  the 
following: 

•  Bibliographic  Searches 

•  General  Information  Responses 

•  Technical  Inquiry  Responses 

•  Papers,  Manuscripts,  Document  Requests 

•  Referrals  to  Experts,  Other  Information  Resources. 

During  out  study,  we  attempted  to  determine  the  benefits  of  GACIAC  core  program 
information  products  and  services.  The  results  of  our  review  are  described  below. 

C.  BENEFITS  FROM  THE  CORE  PROGRAM 

1 .  Types  of  Core  Products  and  Services 

As  illustrated  in  Table  5-2,  GACIAC  has  an  extensive  list  of  publications  which  are 
generally  available  to  government  and  DoD  contractor  personnel  with  appropriate 
clearances  and  need  to  know.  GACIAC  also  publishes  a  quarterly  newsletter.  The 
Director  of  GACIAC  also  publishes  a  weekly  newsletter  intended  for  members  of  the 
JSGCC.  The  GACIAC  staff  are  very  helpful  and  provide  a  wide  range  of  technical 
inquiry,  bibliographic  inquiry,  and  referral  services. 

GACIAC  provided  IDA  with  a  complete  listing  of  289  Individual  Response  core 
services  for  the  period,  calendar  year  1988.  Table  5-3  provides  a  breakdown  of  the  kinds 
of  organizations  requesting  Individual  Response  Core  Services  during  FY  1988.  Table  5-4 
summarizes  the  types  of  services  or  information  provided  on  an  individual  response  basis 
by  GACIAC 

In  older  to  identify  specific  benefits  to  DoD  and  its  contractors,  we  asked  GACIAC 
to  identify  individual  response  core  information  products  and  services  for  calendar  year 
1988  by  product  or  service  type.  This  information  is  presented  in  Table  5-4. 

On  the  basis  of  the  list  of  calendar  year  1988  individual  response  users,  we 
undertook  an  extensive  telephone  survey.  We  attempted  to  contact  as  many  of  the 
identified  individual  recipients  as  we  could  reach  to  conduct  a  survey  of  benefits  and  costs 
of  IAC  core  products  and  services.  The  results  of  our  survey  are  described  below. 
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Table  5-3.  GACIAC  Cora  Individual  Response  Users, FY1986-1988: 
Classification  by  Organization  Type 


Department  of  Defense 

Air  Force  24 

Army  57 

Navy  39 

OSD  1 

Other  DcD  7 

Department  of  Defense  Contractors  141 

Other  U.S.  Government  Agencies  5 

Academic'Professional  1 2 

Private  Industry  3 

GACIAC  Core  Individual  Response  Task  Population  289 


Table  5-4.  GACIAC  Individual  Response  Core  Services  Provided, 
By  Service  Type,  CY  1988 


Bibliography 

9 

Conferences 

4 

Documents 

43 

General  Information 

2 

GACIAC  Core  Individual  Response 

56 

2 .  Benefits  of  General  Distribution  Products 

In  the  case  of  the  GACIAC  newsletter,  the  survey  data  collected  by  GACIAC 
shows  strong  user  support  for  and  satisfaction  with  the  GACIAC  newsletter.  In  the  case  of 
other  GACIAC,  CBIAC,  and  RAC  products,  we  found  a  small  number  of  surveys  returned 
to  IACs  by  users,  nearly  all  of  which  expressed  appreciation  for  the  quality  and  utility  of 
the  LAC  produce.  It  is  likely  that  users  of  the  IACs  who  were  not  especially  satisfied  failed 
to  return  questionnaires  along  with  other  satisfied  users  who  were  simply  too  busy  to  tell 
the  IACs  about  their  use  of  LAC  supplied  information.  In  general,  IACs  limited  success  in 
stimulating  replies  to  its  mailed  surveys  discouraged  us  from  attempting  a  broad  survey  of 
core  general  distribution  products. 

Due  to  the  widespread  distribution  of  GACIAC  state-of-the-art  reports,  critical 
reviews,  and  other  current  awareness  products,  we  determined  it  would  be  uneconomical  to 
expend  study  resources  to  attempt  to  assess  the  benefits  to  DoD  of  such  products. 
However,  during  our  interviews  with  core  program  users  who  had  requested  specific. 
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individualized  information  products  or  services,  we  were  told  of  benefits  that  accrued  not 
only  from  the  individual  response  but  the  general  distribution  items  noted  above  as 
well.  Although  we  did  not  keep  statistics  on  such  benefits,  there  were  strong  sentiments 
expressed  by  many  users  with  whom  we  spoke  that  GACIAC  general  distribution 
documents  were  very  helpful  in  promoting  standardization  and  enhancing  communication. 

Conference  proceedings,  in  particular,  were  singled  out  by  many  users  of  other 
GACIAC  core  products  and  services  as  being  particularly  helpful.  Such  proceedings  often 
captured  technical  information  within  weeks  or  months  after  its  generation.  GACIAC  was 
singled  out  by  several  users  as  an  exceptionally  responsive  and  responsible  organization  for 
making  available  information  from  classified  conferences  dealing  with  precision  guided 
munitions  technology. 

3.  Benefits  of  Individual  Response  Services 

In  order  to  better  understand  the  benefits  and  costs  of  core  products  and  services  to 
GACIAC  users,  we  sought  out  a  sample  of  individual  response  products  or  services  to  be 
interviewed  by  telephone.  Our  sample  focused  on  those  users  who  received  either  a 
bibliography  or  an  answer  to  a  technical  inquiry.  Of  the  283  GACIAC  users  identified  as 
having  received  bibliographies,  referrals  to  other  sources,  or  answers  to  technical  inquiries, 
we  were  able  to  interview  50  users.  Most  of  the  document  recipients  were  technical 
information  specialists,  librarians,  or  other  information  conduits.  In  addition,  GACIAC 
provided  us  with  disposition  forms  for  nine  clients  who  had  received  bibliographies;  of  this 
number,  we  were  able  to  contact  seven  of  them.  Therefore,  few  users  we  contacted  were 
able  to  quantify  the  benefits  that  GACIAC  provided  their  organization. 

In  addition  to  these  50,  we  spoke  with  other  users  who  acted  as  intermediaries 
between  GACIAC  and  bench  level  scientists,  engineers,  or  researchers.  Most  of  these 
additional  conversations  were  with  librarians,  many  of  whom  could  not  identify  specific 
benefits.  They  did  report  that  their  users  found  GACIAC  beneficial  because  they  were 
continually  directed  use  GACIAC,  even  if  it  was  difficult  to  obtain  GACIAC  documents. 

Subsequent  to  our  visit  to  GACIAC  and  follow-up  telephone  calls,  GACIAC 
implemented  new  procedures  to  assist  users  in  ordering  documents.  It  is  our 
understanding  that  the  flow  of  information  from  GACIAC  to  its  users  has  accelerated. 
Clearly,  the  users  with  whom  we  spoke  found  the  general  distribution  publications  of 
value,  especially  in  facilitating  communication  within  the  precision  guided  munitions 
community,  and  wanted  better  access  to  these  publications. 
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Tabic  5-5  summarizes  the  general  results  of  our  sample  of  IAC  core  Individual 
Response  services  at  GACIAC.22  We  were  able  to  contact  representatives  of  all  three 
military  services  as  well  as  significant  contractors  to  DoD  involved  in  precision  guided 
munitions  RDT&E. 

Table  5-5.  GACIAC  Core  Users  Survey-Individual  Response  Service  Users 

CY1988 


User  Agency 

27 

DoD  Users 

26 

DoD  Contractors 

2 

Other  U.S.  Government  Agencies 

1 

Commerdai  Ventures 

Nature  of  Task 

9 

Critical/Annotated  Bibliographies 

4 

Conferences 

43 

Documents 

2 

General  Information 

Amount 

of  Quantified  Benefit 

1 

Cora  Funded  Task  Reported  A  Quantified  Benefit 

Methods 

Used  to  Quantify  Benefits  by  Users 

Benefit  of  task  quantified  on  basis  of  time  or  effort  saved 

As  in  the  case  of  CBLAC,  GACIAC  is  providing  core  information  via  individual 
response  to  inquiries  or  referral  requests  to  representatives  of  all  three  military  services, 
components  of  the  Department  of  Defense,  DoD  contractors,  and  other  U.S.  Government 
agencies. 

The  following  discussion  summarizes  information  collected  and  presented  in 
Appendix  E  to  this  report. 

(a)  Quantitative  Benefits 

Most  GACIAC  users  with  whom  we  were  able  to  speak  work  in  environments 
where  quantifying  research  and  development  work  output  is  not  done.  Even  upon 
extended  prompting,  GACIAC  users  could  not  readily  conceptualize  the  costs  they  would 


22 


It  should  be  borne  in  mind  that  this  sample  was  generated  primarily  on  the  basis  of  our  ability  to 
identify  individual  users  and  contact  them  by  telephone. 
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have  incurred  had  they  gone  elsewhere  for  information  provided  by  GACIAC.  They  could 
not  assign  a  value  to  the  amount  of  rime  GACIAC  had  saved  them,  nor  could  they  estimate 
the  value  to  their  organization  of  changes  in  organizational  plans,  programs,  or  behaviors 
as  a  result  of  an  answer  or  other  information  item  provided  by  GACIAC. 

There  was,  however,  one  individual  who  did  indicate  that  GACIAC  provided  him 
with  a  quantifiable  benefit  based  on  documents  provided.  While  he  described  the  chief 
benefit  that  GACIAC  documents  had  provided  him  as  one  of  providing  support  for  the 
work  he  was  doing  at  the  time,  he  indicated  that  had  he  had  to  search  for  similar 
information  for  himself,  he  would  have  spent  six  to  seven  weeks  in  the  library.  Thus,  the 
minimum  benefit  reported  by  this  user  was  6  to  7  weeks  of  saved  professional  labor. 

Four  other  GACIAC  customers  described  quantifiable  benefits,  but  failed  to 
provide  or  were  unable  to  attach  numbers  to  the  savings.  All  four  described  the  benefits  of 
GACIAC  assistance  generally  as  savings  in  terms  of  time.  One  user  had  come  uninitiated 
into  the  area  of  guidance  and  control.  He  explained  that  if  he  had  to  find  out  what 
technologies  were  available  and  what  other  people  were  doing,  he  could  have  done  so,  at  a 
cost  of  time  and  manpower. 

Another  user  described  his  time  savings  in  terms  of  shortened  development  time. 
Because  of  referrals  that  GACIAC  provided,  he  was  able  to  go  directly  to  companies  that 
were  working  in  areas  he  was  interested  in.  Like  the  first  user,  he  stated  that  he  could  do 
the  work  that  GACIAC  had  done  for  him,  but  that  he  did  not  have  enough  time.  As  a  result 
of  their  input  and  the  information  provided  by  their  referrals,  he  was  able  to  find  out  what 
did  and  did  not  work,  so  he  was  able  to  shorten  development  time  significantly. 

A  government  customer  used  documents  prepared  by  GACIAC  as  entry  level 
training  manuals.  He  indicated  that  he,  too,  could  provide  similar  information  (in  this  case 
technical  training  manuals)  but  knew  for  fact  that  it  would  take  many  months  to  develop 
something  similar.  There  was  a  further  saving  in  the  amount  of  time  it  took  his  new 
engineers  to  come  up  to  speed  in  Air  Force- specific  areas.  As  he  pointed  out,  many  of  the 
engineers  were  very  well  trained  in  general  engineering  areas;  however,  specific  guidance 
and  control  areas  are  rarely  discussed  in  most  college  and  university  engineering  and 
science  courses. 

Finally,  a  government  librarian  was  able  to  report  a  time  saving.  The  librarian,  who 
was  not  the  prime  user  of  the  GACIAC  documents,  reported  that  GACIAC  was  very 
responsive-- significantly  more  so  than  alternative  sources  she  had  to  work  with.  In  this 
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particular  case,  responsiveness  meant  that  they  not  only  sent  what  she  requested,  but  they 
sent  it  to  her  promptly  and  directly. 

In  summary,  all  the  benefits  were  the  result  either  of  time  and  effort  saved  or,  in  the 
case  of  the  librarian,  of  not  having  to  go  to  an  alternate  source.  The  engineer,  who 
quantified  a  time  saving,  indicated  he  saved  5-7  weeks  of  labor.  An  arbitrary  value  of 
$30.00  per  hour  (fully  loaded)  for  a  junior  engineer  provided  an  estimated  cash  savings  of 
$7,200-$8,400.  The  other  four  quantifiable,  but  unquantified,  benefits  result  from  time 
savings. 

(b)  Qualitative  Benefits 

As  mentioned  earlier,  most  of  the  GACIAC  users  interviewed  were  recipients  of 
documents.  In  the  case  of  GACIAC,  the  recipient  typically  was  a  third  party  who  did  not 
actually  use  the  documents  himself.  Even  though  GACIAC  users  with  whom  we  spoke 
were  not  intimately  familiar  with  the  documents  that  arrived  for  use  in  their  companies' 
research  and  development  efforts,  most  were  able  to  describe  some  benefit  from  the 
information  provided. 

As  in  the  case  of  CBLAC,  the  benefits  described  fall  into  one  or  more  of  the 
following  categories: 

•  Verification  of  information; 

•  Absolute  objectivity, 

•  Enhanced  productivity, 

•  The  ability  to  work  to  standards  (in  some  cases,  the  standards  the  IAC  helped 
to  produce); 

•  Greater  competition; 

•  Enhanced  communication;  and 

•  Improved  military  capability. 

Each  of  these  defined  benefits  will  be  discussed  in  greater  detail  below. 

(i)  Verification/Substantiation 

Verification  of  information  does  not  merely  include  an  IAC's  stating  that  the 
information  is  correct;  it  includes  enhancing  the  confidence  that  the  IAC  user  has  about  his 
technique  or  solution.  In  the  survey,  two  GACIAC  users  reported  that  the  IAC  they  had 
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used  had  provided  significant  benefit  by  verifying  or  substantiating  data  obtained  from 
other  sources. 

(ii)  Objectivity  and  Neutral  Competence 

Objectivity  was  another  important  benefit  for  users  included  in  our  current  study. 
Two  GACIAC  users  reported  going  to  the  LACs  because  they  were  objective.  One  user 
reported,  particularly  in  the  case  of  state-of-the-art  reviews,  GACIACs  objectivity  was 
critical  since  it  had  no  particular  institutional  or  programmatic  prejudice.  In  addition,  he 
believed  that  because  GACIAC  was  independent  and  carried  a  quasi-govemmental  flavor, 
for-profit  companies  would  be  more  willing  to  discuss  proprietary  information  with  it23 

(iii)  Enhanced  Productivity 

Four  GACIAC  users  reported  that  they  used  various  handbooks,  critical  reviews, 
and  state-of-the-art  reports  as  technical  manuals  and  primers  to  train  new  staff  members, 
r  .-cording  to  these  interviewees,  use  of  the  GACIAC  documents  substantially  unproved  the 
performance  of  the  engineers  and  technical  support  staff.  The  information  contained  in 
each  is  focused,  directed,  and  topical,  and  more  nearly  meets  the  needs  of  the  new 
government  or  government  oriented  engineer  than  other  academic  or  commercial  texts. 

Three  GACIAC  users  reported  savings  of  time  and  effort  based  on  avoiding  a  need 
to  perform  expensive  laboratory  tests.  These  GACIAC  users  saved  time  and  resources  by 
not  conducting  tests  which  would  have  unnecessarily  duplicated  existing  data  and 
information.  They  were  able  to  use  their  personnel,  laboratory,  materiel,  and  financial 
resources  for  more  productive  purposes.  Unfortunately  for  this  study,  they  were  unable  to 
quantify  the  savings. 

Five  GACIAC  users  reported  increased  productivity  or  enhanced  efficiency  in  their 
day-to-day  research  activities.  The  specific  qualities  of  improved  productivity  or  enhanced 
efficiency  cited  were  shortened  learning  time,  improved  quality  assurance/quai'ity  control, 
and  improved  labor  productivity.  Again,  the  users  were  unable  to  quantify  these 
descriptors  of  "improved  productivity." 


23  We  found  few  commercial  organizations  who  were  IAC  users  who  objected  to  providing  proprietary 
information  to  DoD  IACs.  As  long  as  the  companies  which  generated  proprietary  data  remained 
confident  that  such  information  would  be  protected  from  unauthorized  use  by  their  competitors,  they 
were  pleased  to  provide  the  LACs  with  such  information. 
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Two  GACIAC  users  reported  using  information  provided  by  GACIAC  to  justify 
and  make  design  changes. 

(iv)  Standards  and  Standardization 

One  GACIAC  user  reported  that  his  agency  and  GACIAC  were  involved  in  related 
areas  of  guidance  and  control.  Standards  for  guidance  and  control  systems  prepared  with 
the  assistance  of  GACIAC  made  it  possible  for  this  user  to  map  data  points  in  an 
experiment  he  was  conducting.  This  task  would  not  have  been  accomplished  without  the 
basic  standards  for  technical  data  related  to  guidance  and  control  established  by  GACIAC. 
Handbooks  and  models  prepared  by  GACIAC  figure  prominently  in  the  deliberations  of 
the  Joint  Technical  Coordinating  Group  on  Munitions  Effectiveness. 

(v)  Enhanced  Communication 

One  of  the  most  commonly  mentioned  benefits  provided  by  GACIAC  was  that  it 
provided  a  forum  to  permit  wide-ranging  technical  discussions  between  government  and 
industry;  among  various  government  agencies;  and  with  industry  with  respect  to  the  state- 
of-the-art  in  the  field  of  tactical  weapons  guidance  and  control.  Government  representa¬ 
tives  stated  that  because  of  GACLACs  involvement  in  conferences,  seminars,  and  working 
groups,  they  were  well  aware  of  what  was  occurring  at  other  government  laboratories  a.id 
agencies.  As  one  government  scientist  put  it,  because  of  GACIAC  he  was  no  more  than 
three  months  behind  the  power  curve  at  any  given  time.  Additionally,  the  contact  with  his 
peers  gave  him  a  "heads  up"  as  to  documents  and  studies  to  be  released.  Another  DoD 
scientist  stated  that  often  government  and  industry  do  not  communicate  well  with  each 
other-industry  does  not  understand  why  government  pursues  the  courses  it  does  and 
government  sometimes  appears  to  be  insensitive  to  the  needs  of  industry. 

As  a  result  of  GACIAC’s  conferences,  symposia,  working  groups,  and 
workshops,  and  the  resulting  conference  proceedings,  both  the  public  and  the  private  sector 
are  able  to  discuss  what  they  are  doing  and  why.  It  helps  to  clear  up  misunderstandings 
and  prevents  situations  from  becoming  problem  areas.  This  sentiment  was  echoed  by  a 
member  of  the  private  sector  who  stated  that  he  was  able  to  do  a  better  job  working  in  his 
area  (missile  seeker  technology)  because  of  the  cross  fertilization  between  industry  and  the 
government. 
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(vi)  Enhanced  Competitiveness 

None  of  GACIAC's  users  with  whom  we  spoke  identified  GACIAC  as  a  source  of 
information  which  had  assisted  in  making  informed  bid/no  bid  decisions  on  government 
procurements.  None  specifically  identified  GACIAC  as  a  source  of  information  used  to 
support  preparation  of  responses  to  solicitation.  However,  two  users  did  cite  GACIAC  as 
a  source  of  information  used  to  justify  or  make  design  changes.  This  suggests  that 
GACIAC  information  could  be  used  in  the  future  to  enhance  competition. 

(vii)  Improved  Military  Capability 

Two  users  who  are  engaged  in  operational  test  and  evaluation  activities  told  us 
independently  that  the  PGM  Handbook  produced  by  GACIAC  is  used  as  a  primary  training 
document  for  personnel  engaged  in  flight  test  operations  of  precision  guided  munitions. 
Since  many  of  these  fliers  rotate  from  active  units  in  the  fleet  and  return  after  short  tours  at 
the  user’s  facility,  the  improved  training  for  purposes  of  operational  test  and  evaluation 
translates  into  improved  military  capability  in  very  short  order. 

Another  user  located  in  laboratory  environment  in  which  training  of  military 
personnel  involved  in  field  activity  occurs  reported  similarly  that  the  use  of  GACIAC 
handbooks  was  a  valuable  tool  which  resulted  in  improved  productivity  for  the  engineers 
assigned  from  field  units  to  the  laboratory  on  temporary  duty  .  These  individuals  returned 
to  their  units  in  the  field  more  capable  at  least  in  part  because  of  their  use  of  GACIAC 
information,  and  thereby  improved  operational  readiness  and  military  capability. 

D.  BENEFITS  FROM  SPECIAL  TASKS 

I.  Background 

As  in  the  case  of  CBIAC,  the  study  methodology  to  assess  benefits  of  special  tasks 
was  quite  straightforward.  Wc  examined  the  list  of  special  tasks  provided  by  GACIAC  for 
the  period  FY  1987-FY  1988  to  determine  whether  there  were  either  individual  heavy  users 
of  each  LAC  or  geographic  concentrations  of  heavy  users,  and  found  that  we  could  cover 
most  of  the  users  with  only  a  few  trips.  Utilizing  a  questionnaire  to  provide  a  framework 
for  data  collection,  we  conducted  interviews  with  special  task  users  of  GACIAC.  We  did 
find  special  tasks  initiated  in  FY  1986  and  FY  1987  considerably  harder  to  assess.  In  these 
more  dated  tasks,  many  of  the  requiring  organizations  had  been  merged  into  other 
organizations  or  reorganized  out  of  existence.  Many  of  the  individuals  most  familiar  with 
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the  results  of  the  task  and  the  subsequent  use  of  information  had  frequently  rotated  to  new 
positions. 

Table  5-6  characterizes  the  population  of  special  tasks  of  which  we  were  aware  at 
the  beginning  of  the  current  phase  of  our  study  for  each  of  the  IACs. 


Table  5-6.  Sample  IAC  Special  Task  Users  by  Military  Service 


SERVICE 

GACIAC 

Air  Force 

3 

Army 

15 

Navy/Marines 

5 

OSD 

0 

Other  USG 

Total  Population 

24 

We  were  able  to  collect  data  through  interviews  on  20  GACIAC  tasks.24  Data  was 
collected  through  hour  long  interviews  followed  up  from  time  to  time  by  additional 
telephone  conversations  or  correspondence.  Table  5-7  captures  the  degree  to  which  our 
study  was  able  to  cover  the  special  tasks  undertaken  by  each  IAC. 


Tabla  5-7.  Coverage  of  Special  Tasks  by  Representative  Sample  Study 


Air  Force 

Army 

Navy 

Tasks 

Dollars 

Tasks 

Dollars 

Tasks 

Dollars 

GACIAC 

100% 

100% 

75% 

94% 

100% 

100% 

During  this  phase  of  our  study,  we  attempted  to  better  understand  the  source  of 
funds  being  used  to  support  special  studies  being  performed  by  DoD  TACs.  Table  5-8 
illustrates  the  diversity  of  budget  categories  for  IAC  special  studies  examined  during  the 
course  of  this  phase  of  our  study. 


24  For  purposes  of  simplifying  travel  planning  and  analysis  of  data,  we  have  treated  multiphase  special 
tasks  conducted  for  the  same  requiring  activity  as  one  task  ever,  though  the  IACs  will  report  each  phase 
as  a  separate  task.  As  a  result,  we  understate  by  a  small  margin  the  number  of  tasks  actually  reviewed 
for  each  IAC  covered  in  this  report  in  comparison  with  the  number  of  tasks  reported  by  the  LAC 
Program  Office  at  DTIC. 
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Table  5-8.  Budget  Categories  of  Special  Studies  Performed  by  Three  DoD  lACs 


Budqet  Category 

AF 

C31AC 

AR 

N 

Unknown 

8 

6.1 

6.2 

4 

6 

1 

6.3A 

4 

5 

6.3B 

1 

6.4 

2 

O&M 

1 

Procurement 

This  table  treats  each  occurrence  of  a  budget  category  as  a  discrete  source  of  funds 
even  though  there  are  several  instances  in  which  funds  from  multiple  budget  categories  are 
used  to  support  one  task. 

As  was  the  case  with  CBIAC,  the  GACIAC  Director  and  the  GACIAC  Technical 
Monitors  (COTRs)  were  generally  unaware  of  or  uncertain  about  the  category  of  funds 
being  expended  at  GACIAC  in  the  procurement  of  special  studies.  We  were  able  to 
identify  the  category  of  funds  being  used  to  procure  a  special  task  only  by  talking  with  the 
special  task  requiring  activity.  In  the  cases  of  tasks  conducted  in  1985  and  1986,  many  of 
the  technical  monitors  for  those  tasks  have  moved  on  in  their  careers  or  left  government, 
making  it  difficult  to  acquire  accurate  data  about  funding,  costs,  benefits,  and  uses  of 
special  task  generated  information. 

2 .  Summary  Results 

We  found  only  5  special  task  users  from  a  sample  population  of  14  GACIAC 
special  task  users  able  to  present  evidence  of  a  quantified  benefit  measured  in  dollars.  The 
results  shown  in  Table  5-9  illustrate  that  the  benefits  outweigh  the  contract  costs  for  those 
special  tasks  where  quantitative  benefits  could  be  identified  and  substantiated.  The  data 
underlying  this  table  will  be  discussed  in  greater  detail  below. 

We  also  found  several  LAC  special  task  users  who  described  the  results  of  IAC 
special  tasks  in  terms  that  lead  us  to  believe  at  some  future  point  in  time  it  will  be  possible 
to  quantify  the  benefits  of  the  IAC  work;  it  is  not  possible  to  do  so  at  this  time.  Finally,  we 
found  several  IAC  users  who  told  us  of  benefits  that  had  been  received  from  the  work 


performed  by  an  LAC  which  were  important  to  their  programs  but  could  not  now  be 
quantified  nor  was  it  ever  likely  that  such  benefits  would  be  quantifiable. 

Table  5-3.  Quantitative  Benefits  From  Selected  DOD  IAC3 


IAC 

#  of  Tasks 
with  Banoflt 

Data 

Total  Cost  of 
Banaflt  Data 
Tasks 

Quantified 

Valua  of 
Banaflts 

Benefit  Calculation 
Method 

#  of  Tasks 
Quantified 
Banaflts 

Cost  of 
Quantified 
Benefits  Tasks 

GACIAC 

14 

$5,286,000 

$5,045,000 

LOWER  LABOR  RATES 
REDUCTION  IN  FIELD 

TEST  TIME 

ACCELERATION  OF  R&D 

5 

$1,642,000 

Table  5-10  summarizes  the  results  of  our  efforts  to  categorize  the  benefits  reported 
by  special  task  users  of  GACLAC,  in  terms  of  quantified,  quantifiable,  defined  and 
undefined  benefits.  As  the  table  makes  clear,  most  special  task  users  with  whom  we  spoke 
were  able  to  define  the  benefits  of  IAC  special  tasks  for  their  research  and  engineering 
programs;  they  were  frequendy  able  to  define  the  benefits  of  special  tasks  in  terms  that 
might  permit  quantification  of  benefit  in  terms  of  dollars  saved  or  hours  saved  at  some 
future  point  in  time.  Several  users  reported  benefits  that  might  at  some  future  point  be 
reported  in  terms  of  improved  performance  of  military  personnel  as  measured  by  standard 
training  techniques. 

Table  5-10.  ,  Benefit  Categories  Reported  by  Spoclal  Taak  Users  of 
GACIAC,  CBIAC,  end  RAC 


Benefit  Type 

GACIAC 

Not  klnown 

4 

Quantified 

5 

Quantifiable  but  no  data  available 

4 

Defined  but  not  quantifiable 

10 

Not  defined 

1 

It  should  be  noted  further  that  several  users  reported  benefits  that  were  both 
quantifiable  as  well  as  defined  but  not  quantified-e.g.,  future  improvements  in  military 
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personnel  performance  in  training  (quantifiable)  and  enhancement  of  deterrence  (not 
quantifiable). 

3.  Quantitative  Benefits  Assessment 

We  identified  20  special  tasks  conducted  by  GACIAC  on  behalf  of  various 
U.S.  Government  sponsors.  Of  this  number,  we  were  able  to  obtain  detailed  information 
on  14  tasks,  several  of  which  spanned  two  or  more  fiscal  years.  Of  these  14  tasks,  five 
special  task  users  who  spent  $1,767,000  in  aggregate  for  their  respective  special  tasks 
reported  benefits  valued  at  $5,045,000.  Table  5-11  summarizes  data  collected  on  those 
special  tasks  in  which  users  provided  sufficient  data  to  establish  quantitative  benefits  to 
DoD  from  GACIAC  special  tasks. 

Users  at  the  Army's  Vulnerability  Assessment  Laboratory  asked  GACIAC  for 
assistance  in  characterizing  electrooptical  information  needed  to  assess  countermeasures 
and  counter-countermeasures  for  various  precision  guided  munitions.  These  users  reported 
that  the  preliminary  results  of  a  $657,000  task  have  already  netted  benefits  of  $750,000; 
further  results  from  this  series  of  special  studies  are  eagerly  awaited. 

GACIAC  analysis  of  materials  used  in  Air  Force  precision  guided  munitions 
programs  were  valued  by  the  program  manager  in  terms  of  a  2  to  1  improvement  in  the 
processing  of  new  materials.  IDA  placed  a  minimum  dollar  value  of  benefit  to  the  Air 
Force  resulting  from  this  task  of  $770,000.  A  special  study  undertaken  on  behalf  of  the 
Pacific  Missile  Test  Center  to  improve  the  performance  of  the  Aegis  guided  missile 
cruiser's  anti-aircraft  systems  has  resulted  in  benefits  to  the  Navy  valued  in  excess  of 
$300,000.  Of  those  special  task  users  who  reported  quantifiable  benefits,  one  of  the  most 
dramatic  assessments  of  benefit  came  from  the  Pacific  Missile  Test  Center.  This  special 
task  resulted  in  the  development  and  use  of  a  test  range  model  to  improve  overall  mission 
planning  and  effectiveness;  the  benefits  accruing  from  this  task  include  dollars  saved  in 
improved  efficiency  and  economy  of  operations;  improved  range  safety;  better  test  results 
for  equivalent  expenditure  of  test  resources;  and  improved  range  planning.  IDA  staff 
estimates  the  minimum  benefit  resulting  from  this  task  is  $2.5  million.  GACIAC  also 
undertook  a  task  for  the  U.S.  Army  Missile  Command  which  involved  the  integration  of 
test  data  and  the  preparation  of  revised  test  plans  based  on  data  submitted  by  two 
contractors.  The  user  estimated  savings  of  labor  by  his  staff  and  the  contractors  at  twice 
the  value  of  the  task.  IDA  staff  estimated  the  dollar  value  of  these  savings  to  be  $600,000. 


» 
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4.  Qualitative  Benefits  Assessment 

We  found  many  special  task  users  of  GACIAC  unable  or  only  partially  able  to 
quantify  the  benefits  they  received  from  using  a  DoD  LAC.  On  the  other  hand,  these  users 
were  able  to  describe  other  contributions  of  the  work  performed  by  IACs  included  in  our 
study  which  are  of  special  significance  to  DoD,  even  if  the  benefits  cannot  be  quantified  in 
a  direct  or  meaningful  way.  Table  5-12  summarizes  qualitative  benefits  reported  by  special 
task  users  of  GACIAC. 

(a)  Improved  Military  Capability 

Several  GACIAC  special  task  users  identified  several  special  tasks  with  direct 
impact  on  the  capability  of  U.S.  military  forces.  Work  performed  by  GACIAC  for  the 
Pacific  Missile  Test  Centei  on  the  AEGIS  radar  system  has  contributed  directly  to  improved 
electronic  countermeasures  and  electronic  counter-countermeasures.  Studies  undertaken 
for  the  Naval  Weapons  Center  on  the  STTNGER  missile  have  resulted  in  changes  to  the 
missile  which  have  improved  its  performance.  Work  undertaken  by  GACIAC  at  the 
Army's  Vulnerability  Assessment  Laboratory  has  led  directly  to  improved  electrooptical 
countermeasures  and  counter-countermeasures. 

(b)  Objectivity  and  Neutral  Competence 

In  the  case  of  one  GACIAC  task,  MICOM  has  asked  GACIAC  to  look  into  serious 
allegations  of  poor  weapon  system  performance.  In  seeking  GACIAC's  assistance, 
MICOM  concluded  that  other  elements  of  the  Army  and  the  weapon  system  prime 
contractors  had  too  large  a  potential  conflict  of  interest  in  evaluating  the  system’s 
performance.  Accordingly,  GACIAC  was  selected  for  the  analysis  of  data  on  weapon 
system  performance  because  it  had  minimal  interest  in  an  a  priori  outcome. 

(c)  Enhanced  Productivity 

Many  special  task  users  of  GACIAC,  CBIAC,  and  RAC  asserted  in  general  terms 
that  the  results  of  IAC  special  tasks  were  general  increases  in  the  productivity  of  their  own 
organization.  In  particular,  the  GACIAC-sponsored  conferences  for  MICOM  on  materials 
and  robotics  were  identified  as  significant  accelerators  of  the  R&D  process  by  several 
MICOM  attendees.  Staff  of  the  Air  Force  Materials  Laboratory  expressed  similar  views 
about  the  value  of  other  GACIAC  conferences  or  projects  undertaken  with  their 
sponsorship. 
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_ _ _ _ Table  5-12:  Qualitative  Benelils  ol  Selected  GACIAC  Tasks 

TASKl  USER  AGENCY  contact  task  title  funding  task  description  natuhe  of  benefit  amount  of  method  of  calculating  benefit 

*°  BENEFIT 


9 
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SH  47522  1  I  I  j  j ol  l! a  technology  of  counter  end  coun 


Table  5-12:  Qualitative  Benefits  ot  Selected  GACIAC  Tasks  _ 

TASK  I  USER  AGENCY  CONTACT  TASK  TITLE  FUNDING  TASK  DESCRIPTION  NATURE  OF  BENEFIT  AMOUNT  OF  METHOD  OF  CALCULATING  BENEFIT 

10  BENEFIT 
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In  several  instances,  users  of  GACIAC,  CBIAC,  and  RAC  singled  out  the  IAC 
special  tasks  for  important  contributions  in  weapon  system  testing  and  evaluation.  As 
noted  earlier,  GACIAC  played  a  major  role  in  improving  the  quality  of  information 
collected  during  missile  tests  by  the  Pacific  Missile  Test  Center.  GACIAC  has  also  been 
instrumental  in  improving  the  quality  of  test  information  collected  by  the  Army  Test  and 
Evaluation  Command. 

Both  GACIAC  and  CBIAC  have  been  used  by  special  task  customers  to  assist  in 
the  development  of  long  term  research  and  development  plans.  The  Smart  Munitions 
Program  Office  has  used  GACIAC  extensively  in  support  of  the  Office  and  the  Joint 
Committee  on  Guidance  and  Control  to  identify  strengths,  weaknesses,  and  gaps  in  the 
Smart  Munitions  RDT&E  program.  The  Naval  Sea  Systems  Command  has  made  extensive 
use  of  CBIAC  to  identify  strengths  and  deficiencies  in  the  Navy’s  NBC  research  program. 

(d)  Standards  and  Standardization 

GACIAC  has  produced  several  models  of  precision  guidance  munition  performance 
which  are  being  used  by  contractors  throughout  the  community  to  design,  develop,  and 
make  preliminary  judgments  about  the  effectiveness  of  specific  designs  against  specified 
target  types.  Due  to  the  publication  of  this  model,  GACIAC  has  given  the  precision  guided 
munitions  community  a  nominal  or  de  facto  standard  against  which  competing  designs  can 
be  examined.  Several  different  special  task  users  including  staff  of  the  Naval  Weapons 
Center,  the  Smart  Munitions  Program  Office,  the  Army's  Vulnerability  Assessment 
Laboratory,  and  the  Army's  Test  and  Evaluation. 

E.  OTHER  USERS  AND  OTHER  BENEFITS 

1 .  Users  in  DoD  Programs 

In  the  case  of  GACIAC,  the  R&AT  staff  member  responsible  for  tactical  weapons 
guidance  and  control  issues  is  an  active  participant  on  the  Joint  Steering  Committee  on 
Guidance  and  Control.  In  this  capacity,  he  has  the  ability  to  utilize  the  resources  of 
GACIAC  to  assist  him  in  the  review  and  formulation  of  the  R&AT  program  in  this 
important  area  of  military  technology.  Although  at  the  time  of  our  review  the  R&AT  staff 
member  is  relatively  new,  he  has  been  willing  and  able  to  utilize  the  Director  of  GACIAC 
as  an  important  program  adviser. 


90 


2.  Other  Users  Beyond  the  Identified  Specific  IAC  Communities 

GACIAC  has  been  very  active  in  inter-IAC  discussions  and  programs.  It  has 
worked  with  the  Survivability/Vulnerabiliry  Informadon  Analysis  Center  (SURVLAQ  and 
the  Infrared  Information  Agency  (IRIA)  to  share  data,  information  and  reports  where  the 
interests  of  these  IACs  intersect  Based  on  a  review  of  orders  for  GACIAC  documents,  it 
seems  likely  that  military  service  academy  and  training  facilities  are  using  GACIAC  reports 
as  primary  or  secondary  instructional  materials. 

F.  SUMMARY 

In  this  chapter  we  have  presented  data  gathered  on  the  question  of  quantitative  and 
qualitative  benefits  to  DoD  provided  by  the  Tactical  Weapons  Guidance  and  Control 
Information  Analysis  Center.  We  found  relatively  few  quantifiable  benefits  from  the  core 
program  users  with  whom  we  spoke.  We  did  find  a  large  number  of  core  users  who  were 
able  to  categorize  qualitative  benefits  to  their  work  as  a  result  of  GACIAC-fumished 
information.  Table  5-13  summarizes  the  number  of  users  who  were  able  to  report 
qualitative  benefits. 

Table  5-13.  GACIAC  Coro  information  Products  and  Services* 


Qualitative  Benefit 

#  of  Taste 

Reporting  Benefit 

No  Defined  Qualitative  Benefit 

36 

Verification/Substantiation 

3 

Objectivity  SNeutral  Competence 

1 

Enhanced  Productivity 

11 

Standards  and  Standardization 

0 

Enhanced  Communication 

11 

Enhanced  Competitiveness 

2 

Enhanced  Military  Cacabiiity 

3 

*  Tha  total  number  of  benefit  typos  reported  exceeds  sample  size  due 
to  multiple  benefit  typr*s  for  several'  tasks. 


We  were  also  able  to  identify  and  document  several  instances  in  which  GACIAC 
special  tasks  yielded  quantitative  benefits  to  their  users.  Table  5-14  reiterates  data 
presented  in  Table  5-9. 


91 


Tabl«  5-14.  Quantitative  Benefits  From  Selected  DOD  lACa 


IAC 

#  ol  Tasks 

with  Banaflt 
Data 

To;al  Cost  ol 
Benaflt  Data 

Tasks 

#  ol  Tasks 
Quantlllad 
Bsnoflts 

Cost  ol 
Quantised 
Benaflts  Tasks 

Quantlllad 

Valua  ol 
Ba.iaflts 

Banaftt  Calculation 
tlathod 

| 

14 

$5,286,000 

■ 

5 

$1,642,000 

$5,045,000 

LOWER  LABOR  RATES 
REDUCTION  IN  FIELD 
TEST  TIME 

ACCELERATION  OF  R&D 

In  addition  to  these  quantitative  benefits,  several  GACIAC  special  tasks  provided 
DoD  users  with  specific  qualitative  benefits  summarized  in  Table  .5-15. 


Table  5-15.  Qualitative  Benefits  of  Selected  GACIAC  Special  Tasks 


IAC 

QUALITATIVE  BENEFIT 

EXAMPLE 

GACIAC 

IMPROVED  CAPABILITY 

AEGIS  ECCM/ESM  PROGRAM 

STINGER  MODEL 

E-O  MODELING/COUNTERMEASURES 

IMPROVED  TESTING 

AEGIS  TESTING/ASM  TESTING 

ARMY  ANTI-AIR  TESTING 

ADVANCED  AF  MATERIALS  TESTING 

IMPROVED  R&D  PLANNING 

SAM/AAW  SYSTEMS  TESTING 

MATERIALS  FOR  SENSORS 

NEW  SENSOR  MATERIALS  FOR  AF 

MATERIALS  LABORATORY 

ACCELERATED  R&D 

IMPROVED  ANTI-ARMOR  TEST  PROGRAM 

While  it  is  difficult  to  calculate  a  benefit-cost  ratio  for  GACIAC  as  a  whole,  we 
found  that  in  those  instances  where  special  task  benefits  could  be  calculated,  the  benefits 
exceeded  the  costs  by  a  factor  of  a  little  better  than  3.  The  apparent  ber.efit/cost  ratio  of  3  to 
1  for  GACIAC  special  tasks  is  consistent  with  earlier  calculations  for  CBIAC 
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6.  BENEFITS  FROM  RAC 


A.  INTRODUCTION 

The  Reliability  Analysis  Center  (RAC),  operated  by  the  ITT  Research  Institute  under 
contract  to  the  U.5.  Aii  Force's  Rome  Air  Development  Center,  is  the  repository  for 
information  and  analytical  techniques  dealing  with  issues  of  reliability.  The  primary  focus 
of  RAC  has  been  electronics  reliability.  In  recent  years,  its  has  expanded  its  focus  to 
address  issues  of  mechanical  reliability  as  well. 

RAC  has  been  a  pioneer  in  the  development  of  statistical  process  control  techniques 
to  improve  the  reliability  of  electronic  and  other  systems  used  by  the  Department  of 
Defense.  In  addition  to  maintaining  large  data  bases  on  electronic  component  reliability 
statistics,  RAC  also  maintains  an  extensive  collection  of  documents,  journals,  and  serial 
publications  dealing  with  this  subject 

The  following  table  summarizes  RAC  Funding  for  the  period  FY  1985  through 
FY  1989.  This  table  helps  io  put  into  perspective  RACs  core  and  special  task  programs. 


Table  8-1.  RAC  Funding  FY  I9S6-FY  1989 


Fiscal  Year 

1 

■uSSSSSHI 

Additional 
Funding  by 
Services 

Spec'al 

Tasks 

1 

r 

TOTAL 

1985 

$640,000 

$10,800 

$3,042,069 

$265  811 

$3,053,630 

198G 

$480,000 

0 

$3,405,278 

$826,533 

$4.51 1,861 

1987 

$454,600 

0 

$2,099,785 

$503,033 

$3,061,918 

1988 

$425,000 

$235,771 

$2,800,983 

$489,343 

$4,001,102 

1989 

$448,000 

$149,982 

$4,010,612 

$513,055 

$5,1 16,629 

RAC  has  enjoyed  a  relatively  stable  base  of  DLA  support  following  the  substantial 
reduction  in  core  program  in  FY  1986.  It  has  successfully  developed  alternative  products 
and  services  for  which  there  is  a  demonstrated  market  In  particular,  RAC  has  pioneered 
the  use  of  proprietary  training  courses  as  a  means  of  generating  funds  to  sustain  core 
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information  collection  and  analysis.  This  stability  in  external  funding  resulting  from 
product  sales  has  enabled  RAC  to  sustain  the  analysts  central  to  the  core  program  even  in 
the  absence  of  stable  core  funding. 

As  in  the  case  of  CBIAC  and  GACIAC,  the  funds  provided  by  DLA  and  the 
military  services  under  the  category,  additional  service  funding,  support  a  small  nucleus  of 
the  RAC  staff.  Funds  generated  by  external  sales  and  special  studies  provide  the  bulk  of 
the  financial  resources  used  to  support  RAC  staff. 

B  .  CORE  PROGRAM  DESCRIPTION 

The  core  information  and  analysis  program  offered  by  RAC  is  quite  broad.  In 
addition  to  offering  technical  inquiry  and  bibliography  services,  RAC  maintains  a  vigorous 
current  awareness  program  for  its  users.  Included  in  this  current  awareness  program  arc  a 
newsletter,  selected  dissemination  of  information  produced  by  RAC,  and  dissemination  of 
its  own  reports.  RAC  has  pioneered  the  development  of  training  courses  as  an  IAC 
informauen  services. 

Wc  identified  a  wide  range  of  IAC  products  and  services  provided  during  FY  1988 
for  which  users  might  be  identified  and  interviewed  to  obtain  their  insights  into  the  benefits 
and  costs  of  the  IAC’s  core  program.  As  in  the  case  of  CBIAC  and  GACIAC,  two 
categories  of  core  products  were  identified.  The  first  group  consists  of  general  distribution 
products  including: 

•  Newsletters 

•  State-of-the-Art  Reports 

•  Critical  Reviews  and/or  Technology  Assessments 

•  Conferences  and  Conference  Proceedings 

•  Handbooks  and  Data  Books. 

These  are  produced  on  a  more-or-less  regu'ar  schedule,  depending  to  a  large  degree 
on  the  availability  of  core  funding.  Table  6-2  provides  a  brief  listing  of  core  products 
produced  by  RAC  during  the  period  1984-1988. 

We  did  not  review  the  distribution  list  for  the  newsletters,  but  did  obtain  a  copy  of 
surveys  of  newsletter  readers  to  review  mechanisms  for  obtaining  user  feedback  and  ro 
obtain  comments  on  newsletter  use 
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Table  6-2.  RAC  Cora  Product;},  1934-19S3 


Discrete  Semiconductor  Device  Reliability  (DRS-4) 

Electronic  Equipment  Maintainability  Data  (EEMD-1) 

Electronic  Equipment  Reliability  Data  (EERD-2) 

Electrostatic  Discharge  Symposium  Proceeding,  1984  (EOS-6) 

Electrostatic  Discharge  Symposium  Proceeding,  1985  (EOS-7) 

Electrostatic  Discharge  Symposium  Proceeding  (1986)  (EOS-8) 

(Floppy)  Microcircuit  Reliability  Program  (FMRAP) 

Electronic  Equipment  Reliability  Data  (EERD-23) 

Linear  Interface  Data  (MDR-20) 

Microcircuit  Device  Reliability  Trade  Analysis  (MDR-21) 

Microcircuit  Device  Reliability  Field  Experience  Database  (MDR-21  A) 

Microcircuit  Device  Reliability  Databooks  (set  of  the  2  above)  (MDR-21  S) 

Microcircuit  Screening  Analysis  (MDR-22) 

Microcircuit  Screening  Data  (MDR-22A) 

Microcircuit  Screening  Set  (MDR-22SET) 

Microelectronic  Failure  Analysis  Techniques  (MFAT-1) 

(Hardcopy)  Microcircuit  Reliability  Program  (WRAP) 

Nonoperating  Reliability  Databook  (NCNOP-1) 

Nonelectronic  Part3  Reliability  Data  (NPRO-3) 

Analysis  Techniques  for  Mechanical  Reliability  (NPS-1) 

Primer  for  Reliability,  Maintainability,  and  Safety  Standards  (PRIM-1) 

Nonoperating  Reliability  Prediction  Sysfom  (RAC-NRPS) 

Reliability  Design  Handbook  (RDH-376) 

Practical  Statistical  Analysis  for  the  Reliability  Engineer  (SOAR-2) 

Integrated  Circuit  Quality  Grades:  Impact  on  System  Reliability  and  Life  Cycle  Costs  (SOAR-3) 
Confidence  Bounds  for  System  Reliability  (SOAR-4) 

Surface  Mount  Technology:  A  Reliability  Review  (SCAR-5) 

ESD  Control  in  the  Manufacturing  Environment  (SOAR-6) 

Microcircuit  Screening  Effectiveness  (TRS-1) 

IRPS  Proceedings,  1968-1973  (TR5-2) 

IRPS  Proceedings,  1979-1984  (TRS-2A) 

EOS/ESO  Technology  Abstracts,  1332  (TRS-3A) 

EOS/ESD  Proceedings,  1979-1584  (TRS-4) 

I  ST  FA  Proceedings.  1978-1985  (TRS-5) 

Electrostatic  Discharge  Susceptibility  of  Electronic  Devices  ('/ZAP-1) 
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Like  other  IACs,  RAC  also  provides  core  services  on  an  individual  response  basis. 

m 

Among  the  services  provided  in  this  category  are  the  following: 

•  Bibliographic  Searches 

•  General  Information  Responses 

•  Technical  Inquiry  Responses  q 

•  Papers,  Manuscripts,  Document  Requests 

•  Referrals  to  Experts,  Other  Information  Resources. 

RAC  provides  many  of  its  services  to  individual,  corporate,  or  government  users 
who  pay  a  fixed  fee  for  a  range  of  services.  The  following  discussion  assesses  the  benefits 
of  these  services  to  users  extracted  from  RAC's  user  data  base. 

C.  BENEFITS  FROM  CORE  PROGRAM 

* 

1 .  Types  of  Core  Products  and  Services 

RAC  provided  IDA  with  a  complete  listing  of  92  individual  response  core  services 
for  the  period,  December,  1984-September,  1988.  These  lists  were  used  to  develop  a 

M 

sample  of  core  product  and  service  users  on  which  to  conduct  a  survey  of  benefits  and 
costs  of  IAC  core  products  and  services.  Table  6-3  summarizes  the  types  of  services  or 
information  provided  on  an  individual  response  basis  by  RAC. 

Tabla  6-3.  RAC  Cor«  Individual  Responao  Users  CY  1983-  0 

Classification  by  Organization  Typ« 


m 
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Department  of  Defense 

AiTTTy 

2 

Other  U  S.  Government 

2 

DoD  Contractor 

50 

Commercial  Entires 

7 

Academic/Profess, onal 

2 

Foreign 

NATO 

14 

Non-Nato 

17 

RAC  Cere  Individual  Response  Population 

92 

96 
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Based  on  the  lists  of  core  product  and  services  and  their  consumers  provided  by 
RAC,  we  undertook  a  comprehensive  telephone  survey  to  identify  the  benefits  users 
obtained  from  their  use  of  these  RAC.  Table  6-4  summarizes  the  kinds  of  information  and 
products  and  services  provided  to  users  we  were  able  to  contacf  to  assess  benefits  provided 
by  RAC. 


Table  6-4.  RAC  Individual  Response  Core  Services 
Provided  by  Service  Type 


Documents  22 

Technical  Inquiries  1 P 

Training  1 

RAC  Core  Individual  Response  26 


(Sarr.pto  is  basad  on  RAC  subscription  usars  only) 


The  results  of  our  assessment  of  RAC  core  program  benefits  are  described  below. 

2.  Benefits  of  General  Distribution  Products 

EDA  did  not  systematically  evaluate  general  distribution  products  including 
newsletters,  state-of-the-art  reports,  critical  reviews,  etc.,  during  this  phase  of  our  study. 
We  found  in  the  ^ase  of  RAC,  like  the  cases  of  CBIAC  and  GACIAC,  that  although  such 
core  program  information  products  frequently  are  sent  to  individual  addressees,  it  was 
difficult  to  determine  who  the  ultimate  users  of  these  products  really  are. 

During  our  review  of  special  tasks,  we  did  meet  with  several  IAC  users  who 
volunteered  information  on  the  benefits  of  selected  RAC  core  products  which  they  had 
received  in  the  past  For  example,  staff  at  the  Naval  Avionics  Center  in  Indianapolis,  IN, 
have  used  the  RAC  handbooks  and  state-of-the-art  reports  as  teaching  tools.  These 
documents  were  deemed  especially  valuable  in  introducing  young  engineers  with  a  good 
grounding  in  principles  of  eiectronics  and  electronics  reliability  to  the  special  problems  of 
military  electronics  reliability. 

Staff  at  the  Marine  Corps  Logistics  Center  in  Albany,  GA,  ustd  RAC  handbooks 
and  conference  proceedings  as  part  of  their  on-the-job  training  in  military  reliability  issues. 
The  special  task  user  at  the  Federal  Aviation  Administration  told  us  that  his  staff  benefited 
similarly  from  RAC’s  general  distribution  core  products. 


RAC  routinely  conducts  surveys  of  its  user  communities  to  obtain  feedback  on  its 
products  and  services.  We  reviewed  RAC's  newsletter  survey  file  and  found  most  of  the 
respondents  were  generally  quite  pleased  with  the  newsletter.  Most  had  few  substantive 
comments  on  its  content,  however,  but  were  pleased  to  receive  it.  Generally,  the 
newsletter  is  seen  as  a  vehicle  for  quickly  keeping  tabs  on  the  reliability  community, 
especially  those  organizations  in  the  government  which  are  especially  concerned  about 
electronics  reliability. 

3.  Benefits  of  Individual  Response  Services 

In  order  to  better  understand  the  benefits  and  costs  of  core  products  and  services  to 
RAC  user  community,  we  sought  out  a  sample  of  individual  response  products  and 
services  to  be  interviewed  by  telephone.  Our  sample  focused  on  those  users  who  received 
either  a  bibliography  or  an  answer  to  a  technical  inquiry.  Our  maximum  sample  size  for 
RAC  is  summarized  in  Table  6-5. 


Table  6-5.  Sample  Individual  Response  Items  for  FY  1938 


Biblioqraohv 

Inquiries 

Other  Core  Services 

RAC 

0 

10 

23 

It  must  be  borne  in  mind  that  the  entries  in  Table  6-5  refer  to  specific  products  or 
services  provided  to  named  individuals  who  could  be  located  by  corporate  address  and/or 
telephone  number.  One  should  not  infer  from  this  data  that  RAC  provided  r.o 
bibliographies;  rather  these  items  were  provided  to  individuals  in  DoD  for  whom  no 
address  or  telephone  number  was  readily  available.  Librarians  at  DoD  research  facilities 
were  frequently  the  recipients  of  such  information. 

Table  6-6  summarizes  the  general  results  of  our  sample  of  individual  response  items 
for  RAC.  It  should  be  borne  in  mind  that  this  sample  was  generated  primarily  on  the  basis 
of  our  ability  to  identify  individual  users  and  contact  them  by  telephone.  Appendix  F 
provides  additional  information  from  each  individual  response  product  user  included  in  this 
report. 


Table  6-6.  RAC  Core  Users  Survey  Individual  Response 
Service  User3  FY  1986-FY  1989 


User  Agancy 

1 

DoD  User 

22 

DoD  Contractor 

1 

Foreign  Government 

1 

Acad9mic'Professional 

1 

Other  U.S.  Government 

I  Nature  of  Task 

22 

Documents 

10 

Technical  Inquiries 

1 

Training 

Funding 

1 

User  Billed  $887.60  for  Documents 

Amount 

of  Quantified  Benefit 

1 

task  with  quantified  benefits  in  excess  of  $1,000 

Methods 

Used  to  Quantify  Benefits  by  Uners 

Benefits  based  on  savings  if  alternative  source  of  documents  and 
information  had  been  used 

These  benefits  to  RAC  core  are  discussed  below. 

(a)  Quantitative  Benefits 

RAC  core  users  who  were  interviewed  for  this  study  were  selected  from  a  list  of  92 
subscribers  for  RAC  document  services.  Of  the  92  users,  31  were  physically  based 
outside  the  United  States  and  as  such  were  not  contacted  at  all.  Another  six  individuals 
were  no  longer  employed  at  the  address  provided  by  RAC.  Of  the  remaining  55  core  users 
of  RAC,  we  successfully  interviewed  29  individuals.  Of  that  sample,  only  one  quantified  a 
benefit  from  the  services  he  had  received  from  RAC. 

The  one  core  user  able  to  quantify  the  benefit  of  his  use  of  RAC  had  sought 
independent  verification  of  maintenance  and  reliability  data  from  RAC.  Tnis  user  had 
conducted  an  investigation  for  his  client  which  suggested  that  certain  redundant  systems 
ought  to  have  routine  maintenance.  He  had  generated  his  own  data  to  substantiate  the 
claim;  however,  the  customer  required  an  objective  third  party  to  prove  or  disprove  the 
claim.  He  was  aware  of  an  alternative  source  of  information  (the  Systems  Reliability 
Service  in  the  United  Kingdom).  He  estimated  that  the  cost  of  getting  the  information  from 


them  would  be  at  least  $1,000.  He  also  stated  that  it  would  require  a  trip  to  the 
United  Kingdom  of  at  least  one  month  with  the  attendant  (and  nontrivial)  travel  costs.  In 
addition,  he  added,  if  he  needed  to  clarify  an  issue  with  RAC,  it  was  a  matter  of  making  a 
simple  telephone  call,  a  luxury  he  would  not  have  with  the  alternative  source. 

Six  others  reported  benefits  from  RAC  that  might  have  been  quantified  but  were 
not.  By  and  large,  the  benefits  were  savings  associated  with  not  having  to  generate  and 
maintain  electronics  reliability  data  in-house.  Of  the  six  RAC  core  users,  five  mentioned 
that  they  saved  money  by  not  having  to  perform  expensive  laboratory  tests,  especially  in 
the  area  of  failure  rate  analysis.  They  also  saved  large  amounts  of  time  associated  with  the 
collection  of  comparable  data  on  electronic  component  reliability.  One  individual  pointed 
out  that  some  data  would  take  at  least  two  years  to  derive. 

One  individual  stated  that  his  company  uses  the  data  provided  by  RAC  to  determine 
warranties.  The  data  was  particularly  valuable  in  framing  responses  to  solicitations 
requiring  failure  rates  and  warranty  periods.  This  satisfied  RAC  core  user  further  reported 
that  in  the  absence  of  RAC  data,  he  would  not  even  bother  to  collect  data  or  design 
warranties  for  his  firm's  products.  Given  recent  statutory  requirements  for  warranties  on 
weapon  systems,  in  the  absence  of  RAC  electronic  reliability  data,  this  user’s  firm  would 
probably  withdraw  from  direct  participation  in  the  DoD  industrial  base. 

Another  RAC  core  user  who  is  involved  in  the  manufacture  of  radar  components 
for  submarines  told  us  that  if  RAC  did  not  exist,  the  cost  of  collecting  and  analyzing 
electronic  component  reliability  data  himself  would  be  prohibitive.  Absent  RAC,  this 
manufacturer's  representative  reported  that  his  firm  would  either  seek  a  waiver  from  the 
contractual  requirements  for  radar  failure  rate  data  or  withdraw  from  direct  participation  in 
the  DoD  industrial  base.  The  government’s  options  under  this  set  c*  circumstances  would 
be  quite  limited:  it  could  fund  separately  the  collection  and  analysis  of  failure  rate  data  or 
deal  with  the  uncertainty  of  not  knowing  the  rate  of  failures  of  submarine-borne  radar 
equipment  in  an  operational  environment 

In  summary,  RAC  users  reported  several  instances  of  benefits  which  could  be 
quantified.  One  user  was  able  to  quantify  a  $1,000  savings  because  he  did  not  have  to  go 
to  an  alternative  source.  Six  reported  unquantified  benefits  derived  from  no.  having  to 
perform  expensive  Laboratory  tests  and  maintain  data  collections  over  long  periods  of  time. 

(b)  Qualitative  Benefits 

All  the  RAC  users  interviewed  were  recipients  of  documents. 
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The  benefits  cited  by  users  included  the  following  classes: 

•  Verification  of  information; 

•  Objectivity  and/or  neutral  competence 

•  Enhanced  productivity; 

•  The  ability  to  work  to  standards  (in  some  cases,  the  standards  the  IAC  helped 
to  produce); 

•  Enhanced  communication;  and 

•  Greater  competition;  and 

•  Improved  military  capability. 

Core  users  of  RAC  interviewed  for  this  study  were  able  to  provide  examples  of 
each  type  of  benefit.  For  further  discussion  see  Appendix  F. 

(i)  Verification/Substantiation 

In  the  survey,  four  RAC  users  reported  that  the  IAC  they  had  used  had  provided 
significant  benefit  by  verifying  or  substantiating  data  obtained  from  other  sources.  In  some 
cases,  independent  verification  had  a  quantifiable  benefit  (e.g.,  the  RAC  customer  who 
saved  $1,000  by  not  having  to  go  to  an  alternate  source).  Typically,  however,  users  did 
not  ascribe  that  kind  of  savings  to  verification.  In  the  case  of  RAC  users,  substantiation 
usually  took  the  form  of  verifying  reliability  and  failure  rate  predictions. 

(ii)  Objectivity  and  Neutral  Competence 

Objectivity  has  several  facets  from  the  perspective  of  the  IACs’  user  communities. 
IACs  are  recognized  by  their  user  communities  as  centers  of  excellence  because  of  the 
highly  competitive  process  by  which  the  basic  IAC  contract  is  awarded.  IACs  perform 
collection  and  analysis  of  scientific  and  technical  information;  they  do  not  engage  in  the 
manufacture  of  products  for  DoD  or  other  U.S.  Government  agencies.  IACs  work  for 
OSD  and  all  three  military  services.  The  present  financial  pressures  within  the  IAC 
program  makes  it  impel  ivc  for  DoD  IACs  to  serve  the  broadest  possible  user  base  and  to 
refrain  from  developing  too  close  a  working  relationship  with  any  single  user  or  military 
department.  IACs  therefore  combine  strength  of  technical  analysis  with  the  absence  of 
long-term  financial  or  institutional  interest  to  present  to  their  respective  user  communities  a 
"neutral  competent"  institution  which  can  assist  users  in  the  design,  development, 
implementation,  and  adjudication  of  standards  and  specifications. 
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Objectivity  was  another  important  benefit  for  users  included  in  our  current  study. 
Two  RAC  users,  two  GACIAC,  and  six  CBIAC  users  reported  going  to  the  IACs  because 
they  were  objective.  One  user  reported,  particularly  in  the  case  of  state-of-the-art  reviews, 
GACIAC’s  objectivity  was  critical  since  it  had  no  particular  institutional  or  programmatic 
prejudice. 

(iii)  Enhanced  Productivity 

Five  RAC  users  reported  savings  based  on  avoiding  a  need  to  perform  expensive 
laboratory  tests.  These  LAC  users  saved  time  and  resources  by  not  conducting  tests  which 
would  have  unnecessarily  duplicated  existing  data  and  information.  They  were  able  to  use 
their  personnel,  laboratory,  materiel,  and  financial  resources  for  more  productive  purposes. 

Four  RAC  users  reported  increased  productivity  or  enhanced  efficiency.  The 
specific  qualities  of  improved  productivity  or  enhanced  efficiency  cited  were  shortened 
learning  time,  improved  quality  assurance/quality  control,  and  improved  labor  productivity. 

Three  RAC  users  reported  using  information  provided  by  IACs  to  justify  and  make 
design  changes. 

(iv)  Standards  and  Standardization 

Working  in  conjunction  with  the  U.S.  Air  Force  Rome  Air  Development  Center, 
RAC  is  a  major  custodian  of  several  Military  Standards  (MIL-STDs)  related  to  military 
electronic  components  and  equipment  reliability.  Several  of  the  RAC  users  mentioned 
RAC's  participation  in  establishing  Air  Force  reliability  standards  as  a  reason  for  their 
confidence  in  RAC.  Customers  view  RAC  as  the  authoritative  DoD  voice  in  electronics 
reliability  standards. 

(v)  Enhanced  Communication 

The  basic  DoD  directive  covering  the  collection  and  dissemination  of  scientific  and 
technical  information,  DoD  Directive  3200. 12,  establishes  a  very  ambitious  program  for  the 
communication  of  such  information  between  DoD  components  and  their  contractors.  The 
technical  training  courses  offered  by  RAC  were  widely  praised  by  many  senior  managers 
who  had  sent  their  more  junior  staff  through  these  courses. 
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(vi)  Enhanced  Competitiveness 

One  small  business  RAC  user  reported  significant  improvements  in  his  firm's 
ability  to  compete  for  DoD  contracts  because  of  the  information  provided  by  RAC.  His 
firm  is  involved  in  logistics  analysis  and  management.  It  had  the  capability  to  evaluate 
failure  rate  data  and  to  make  reliability/maintainability  and  failure  predictions  based  on  data 
but  no  reasonable  way  of  conducting  expensive,  time  consuming  experiments  to  collect 
electronics  reliability  data.  The  ability  to  obtain  such  information  from  RAC  enaoled  his 
firm  to  offer  technical  analysis  services  to  the  government  Absent  the  existence  of  RAC, 
his  firm  would  not  be  able  to  compete  with  large  businesses.  The  fact  that  the  data  was 
available  for  his  scientists,  engineers,  and  analysts  to  use  allowed  a  prime  contractor  to 
subcontract  business  to  his  firm. 

(vii)  Improved  Military  Capability 

Three  commercial  users  of  RAC  identified  the  IAC  as  an  important  source  of 
information  bearing  on  the  reliability  of  military  equipment  either  deployed  with  U.S. 
forces  or  about  to  enter  the  inventory.  Systems  identified  by  these  users  included  AEGIS, 
TARTAR,  PATRIOT,  and  torpedoes. 

D.  BENEFITS  FROM  SPECIAL  TASKS 

1 .  Background 

As  in  the  case  of  CBIAC  and  GACIAC  special  task  users,  our  approach  to  RAC 
special  task  users  was  quite  straightforward.  We  examined  the  list  of  special  tasks 
provided  by  RAC  to  identify  either  individual  heavy  users  or  geographic  concentrations  of 
heavy  users.  Table  6-7  characterizes  the  population  of  special  tasks  of  which  we  were 
aware  at  the  beginning  of  the  current  phase  of  our  study  for  each  of  the  IACs. 

Table  6-7.  Sample  IAC  Special  Task  Users  by  Military  Service 


Service 

PAC  Users 

Air  Force 

2 

Army 

5 

Navy/Marines 

4 

OSD 

1 

Other  USG 

1 

Total  Population 

12 

103 


We  were  able  to  collect  data  through  interviews  on  8  RAC  tasks.25  Data  was 
collected  through  hour  long  interviews  followed  up  from  time  to  time  by  additional 
telephone  conversations  or  correspondence.  Table  6-8  captures  the  degree  to  which  our 
study  was  able  to  cover  the  special  tasks  undertaken  by  each  LAC. 


Table  6-8.  Coverage  of  RAC  Special  Tasks 


Air  Force 

Army 

Navy 

Tasks 

Dollars 

Tasks 

Dollars 

Tasks 

Dollars 

RAC 

50% 

91% 

27% 

50% 

75% 

90% 

As  in  the  case  of  CBIAC  and  GACIAC,  we  attempted  to  leam  which  communities 
were  funding  special  tasks  at  RAC  based  on  funding  categories.  Table  6-9  summarizes  the 
results  of  our  inquiries  about  funding  sources  with  RAC  users. 

Table  6-9.  Budgat  Categories  of  Special  Studies 
Performed  by  Three  DoD  lACs 


Budget  Category 

AF 

AR 

N 

Unknown 

1 

2 

6.1 

6.2 

6.3A 

II 

1 

6.38 

HI 

1 

6.4 

2 

O&M 

1 

Procurement 

1 

1 

t 

This  table  treats  each  occurrence  of  a  budget  category  as  a  discrete  source  of  funds 
even  though  there  are  several  instances  in  which  funds  from  multiple  budget  categories  are 
used  to  support  one  task.  Unlike  CBIAC  and  GACIAC,  RAC  appears  to  be  providing 
significant  support  to  the  O&M  and  Procurement  community.  This  is  not  especially 


25  For  purposes  of  simplifying  travel  planning  and  analysis  of  data,  we  have  treated  multiphase  special 
tasks  conducted  for  the  same  requiring  activity  as  one  task  even  though  the  IACs  •.•.■•ill  report  each  phase 
as  a  separate  task.  As  a  result,  we  understate  by  a  small  margin  the  number  of  tasks  actually  reviewed 
for  each  LAC  covered  in  this  report  in  comparison  with  the  number  of  tasks  reported  by  the  LAC 
Program  Office  at  DTIC. 


surprising  given  the  relatively  late  stage  in  the  acquisition  process  when  issues  of  reliability 
and  maintainability  receive  significant  attention  by  the  services  and  their  contractors. 


2 .  Summary  Results 

We  found  only  3  RAC  special  task  users  able  to  present  evidence  of  a  quantified 
benefit  measured  in  dollars.  The  results  shown  in  Table  6-10  again  illustrate  that  at  least  in 
aggregate,  the  benefits  outweigh  the  contract  costs  for  those  special  tasks  where 
quantitative  benefits  could  be  identified  and  substantiated.  The  data  underlying  this  table 
will  be  discussed  in  greater  detail  below. 

Tabla  6-10.  Quantitative  Benefits  From  Selected  DOO  IACs 


IAC 

#  of  Tasks 
with  Benefit 

Data 

Total  Cost  of 
Banaflt  Data 

Tasks 

#  of  Tasks 
Quantified 
Banafits 

Cost  of 
Quantified 
Banafits  Tasks 

Quantified 

Value  of 
Benefits 

Benefit  Calculation 
Method 

RAC 

8 

$1,916,000 

3 

$1,225,500 

>$15,330,000 

•  LOWER  LABOR  RATES 
•  COST  AVOIDANCE 

BY  AVOIDING 

OF  AMMO  PLANT 

•  IMPROVED  RELIABILITY 
OF  MilSTAR  SYSTEMS 

We  also  found  several  RAC  special  task  users  who  described  the  results  of  RAC 
special  tasks  in  terms  that  lead  us  to  believe  at  some  future  point  in  time  it  will  be  possible 
to  quantify  the  benefits  of  the  LAC  work;  it  is  not  possible  to  do  so  at  this  time.  Finally,  we 
found  several  LAC  users  who  told  us  of  benefits  that  had  been  received  from  the  work 
performed  by  an  LAC  which  were  important  to  their  programs  but  could  not  now  be 
quantified  nor  was  it  ever  likely  that  such  benefits  would  be  quantifiable. 

Table  6-11  summarizes  the  results  of  our  efforts  to  categorize  the  benefits  reported 
by  RAC  in  terms  of  quantified,  quantifiable,  defined  and  undefined  benefits.  As  the  table 
makes  clear,  most  special  task  users  with  whom  we  spoke  were  able  to  define  the  benefits 
of  LAC  special  tasks  for  their  research  and  engineering  programs;  they  were  frequently  able 
to  define  the  benefits  of  special  tasks  in  terms  that  might  permit  quantification  of  benefit  in 
terms  of  dollars  saved  or  hours  saved  at  some  future  point  in  time.  Several  users  reported 
benefits  that  might  at  some  future  point  be  reported  in  terms  of  improved  performance  of 
military  personnel  as  measured  by  standard  training  techniques.  However,  unlike  the  pilot 


study  of  NTLAC,  wc  report  only  one  instance  of  quantifiable  benefits  obtained  for  each 
IAC  included  in  this  phase  of  our  study. 

Table  6*11.  Benefit  Categories  Repotted  by  Special  Task  Users 
Of  GACIAC,  CDIAC,  and  RAC 


Benefit  Type 

RAC  USERS 

Not  Known 

Quantified 

3 

Quantifiable  but  no  data  available 

3 

Defined  but  not  quantifiable 

4 

Not  Defined 

A  more  detailed  discussion  of  both  the  quantitative  and  qualitative  benefits  attributed 
to  RAC  by  its  special  task  users  follows. 

3.  Quantitative  Benefits  Assessment 

Table  6-12  summarizes  special  tasks  performed  by  the  Reliability  Analysis  Center 
for  DoD  components.  A  total  of  15  special  tasks  have  been  undertaken  by  RAC  during  the 
period  1985-1988.  IDA  was  able  to  obtain  information  regarding  the  benefits  of  8  special 
tasks.  Three  special  tasks  with  a  total  cost  of  approximately  $1,225,000  yielded  results 
measuring  in  excess  of  $15,000,000  over  a  four  year  period, 

Picatinny  Arsenal  has  operated  a  large  program  over  the  past  four  years  oriented 
towards  the  design  of  Army  Ammunition  Plants  which  can  be  built,  tested,  and  then 
mothballed  for  a  long  period  of  time  until  needed  in  a  national  emergency  requiring  them  to 
reach  optimum  output  in  a  very  short  period  of  time.  A  team  consisting  of  RAC,  DACS, 
ARDEC,  and  Rock  Island  Arsenal  spent  a  total  of  $7.3  million  on  the  Production 
Readiness  Enhancement  Program.  As  a  result  of  this  program,  the  Army  estimates  that  it 
will  avoid  more  than  a  billion  dollars  in  expenses  associated  with  21  new  ammunition 
plants  as  follows  per  plant; 

•  $20-30  million  in  new  ammunition  plant  construction; 

•  $25  million  in  future  pollution  abatement  costs; 

•  $10  million  in  start  up;  some  $20  to  $30  million  in  new  plant  construction. 
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If  we  allocate  10  percent  of  the  total  savings  of  $1  billion  to  process  control 
technology  and  then  further  allocate  the  savings  among  RAC,  ARDEC,  and  Rock  Island 
Arsenal  based  on  their  financial  participation  in  the  program,  it  appears  that  RACs  efforts 
resulted  in  a  savings  to  the  Army  of  more  than  $9  million. 

There  were  also  substantial  benefits  to  the  Army  reported  in  this  special  task  that 
have  not  yet  been  quantified  which  will  be  discussed  below. 

The  Marine  Corps  Logistics  Center  reports  RAC  was  approximately  2.5  to  3  times 
more  cost  effective  than  another  contractor  in  designing,  developing,  and  implementing  a 
reliability  centered  maintenance  concept  for  new  Marine  Corps  vehicles.  The  MCLC 
approached  RAC  on  the  basis  of  its  publications  because  it  was  dissatisfied  with  the 
incumbent  contractor.  For  approximately  two-thirds  the  cost  of  the  incumbent,  the  RAC 
supplied  superior  models,  data  collection  techniques,  instruction  and  training,  and  analysis 
of  data  on  vehicle  reliability;  furthermore,  it  provided  generic  models  which  will  be  applied 
in  the  future  to  other  wheelcd-vehicle-based  Marine  Corps  systems.  Based  on  data 
available  prior  to  the  conclusion  of  the  special  task,  the  officer  in  charge  of  the  program 
estimated  that  RAC  had  provided  a  benefit  of  approximately  $420,000  for  a  programmed 
cost  of  $374,000. 

Finally,  the  Air  Force  Space  Division  had  tasked  the  RAC  to  develop  a  quality 
assurance  program  for  use  in  connection  with  the  production  of  a  communications  satellite. 
As  a  result  of  the  success  of  the  RAC  program,  the  Air  Force  program  manager  estimated 
that  when  the  system  enters  production  and  continues  in  production  for  more  than  15  years, 
the  total  savings  would  be  in  the  range  of  S9O-S150  million.  Consistent  with  previous 
allocations  of  quantitative  benefits,  we  estimate  the  value  of  RAC’s  contribution  to  the 
program  to  be  only  $6  million,  a  one  time  benefit. 

4.  Qualitative  Benefits  Assessment 

As  in  the  case  of  CBIAC  and  GACIAC,  many  RAC  special  task  users  were  unable 
or  only  partially  able  to  quantify  the  benefits  they  received  from  using  a  DuD  IAO.  On  die 
other  hand,  these  users  were  able  to  describe  other  contributions  of  the  work  performed  by 
RAC.  Table  6-13  summarizes  the  qualitative  benefits  reported  by  special  task  users  of 
RAC. 
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(a)  Improved  Military  Capability 

RAC  special  task  users  also  reported  significant  improvements  in  military  capability 
as  a  result  of  RAC  studies.  The  Air  Force  is  fielding  an  ECM/ECCM  pod  with  the 
assistance  of  RAC.  This  system  is  now  entering  operational  test  and  evaluation  in 
competition  with  another  system.  It  is  performing  as  expected,  and  has  achieved  design 
goals  for  reliability  sooner  than  anticipated.  The  sponsor  attributes  the  program's  success 
to  RACs  assistance.  RAC  has  also  instituted  a  reliability  centered  maintenance  program 
for  the  Marine  Corps  Logistics  Base,  described  above.  In  addition  to  yielding  a  small 
dollar  savings  relative  to  other  contractors,  the  Marine  Corps  staff  with  whom  we  spoke 
described  significant  improvements  in  maintenance.  These  improvements  translate  directly 
into  increased  capability  for  the  Corps.  Finally,  the  Naval  Avionics  Center  identified 
several  avionics  programs  which  in  their  view  had  benefited  from  RAC's  assistance. 
These  avionics  programs  refurbish  or  support  navigation  systems.  Fire  control  systems, 
and  flight  safety  systems  for  several  different  types  of  carrier-based  aircraft.  From  the 
Naval  Avionic  Center’s  perspective,  RAC  had  contributed  very  directly  to  the  operational 
capability  of  the  naval  aviation  community. 

(b)  Objectivity  and  Neutral  Competence 

Our  sample  of  special  task  users  did  not  include  any  users  who  indicated  that  they 
had  gone  to  RAC  because  of  its  presumed  neutrality  or  lack  of  institutional  interest  in  the 
outcome  of  its  analyses.  In  view  of  the  high  marks  given  to  RAC  by  its  core  users,  it  may 
be  that  RAC  special  task  users  simply  assumed  RaC  had  no  interest  in  the  outcome  of  its 
analyses  and  therefore  failed  to  report  this  as  a  significant  benefit 

(c)  Enhanced  Productivity 

No  RAC  special  task  user  explicitly  singled  out  improved  productivity  as  a 
significant  benefit  from  going  to  RAC.  On  the  other  hand,  the  Marine  Corps  Logistics 
Center  at  Albany,  GA,  told  us  that  RAC  was  far  superior  in  performance  to  a  contractor 
who  had  originally  been  hired  to  assist  the  Center  in  the  development  of  a  reliability 
centered  maintenance  program  for  Marine  Corps  armored  vehicles.  The  officer  with  whom 
we  spoke  told  us  that  as  a  result  of  RAC  assistance,  he  was  now  getting  calls  asking  when 
the  next  vehicle  in  the  Marine  Corps'  family  of  light  armored  vehicles  would  be  included  in 
reliability  centered  maintenance  as  opposed  to  calendar  scheduled  maintenance  programs. 


He  told  us  that  from  his  standpoint,  the  Marine  Corps  was  getting  much  better  support  for 
its  O&M  dollars  using  RAC  than  it  had  from  the  previous  contractor. 

(d)  Standa'  is  and  Standardization 

RAC  is  rhe  cus.odian  of  the  Air  Force's  specifications  for  electronic  component 
reliability.  The  Federal  Aviation  Administration's  Terminal  Area  Surveillance  Radar 
progrant  elected  to  use  RAC  precisely  for  this  reason.  The  program  manager  told  us  that  as 
a  result  of  using  the  Air  Force  standards  and  specifications  for  electronic  components,  he 
was  optimistic  about  his  ability  to  field  a  radar  system  that  could  be  supported  for  a  25-  to 
30-year  life.  Although  he  told  us  the  Air  Force-FAA  Memorandum  of  Understanding  on 
Air  Space  Suiveillince  made  it  likely  that  he  would  have  used  Air  Force  specifications  for 
radar  system  components  anyway,  the  success  of  RAC  in  supporting  the  Air  Force 
reliability  standards  and  specifications  gave  him  great  comfort. 

E.  OTHER  USERS  AND  OTHER  BENEFITS 

1 .  Users  in  DoD  Programs 

In  the  case  of  RAC,  there  is  no  official  point  of  contact  on  the  R&T  staff  for 
electronics  reliability.  The  Rome  Air  Development  Center  executes  this  responsibility  for 
the  Air  Force  which  in  turn  provides  a  point  of  coordination  for  the  miiitary  departments 
working  through  the  Joint  Logistics  Commanders  and  the  Joint  Laboratory  Technical 
Directors. 

2 .  Other  Users  Beyond  the  Identified  Specific  IAC  Communities 

RAC  has  been  able  to  train  a  significant  number  of  commercial  quality  assurance 
engineers  in  reliability  analysis  even  though  those  engineers  may  not  be  directly  involved  in 
DoD-oriented  electronics  reseat  ch,  development,  engineering,  or  production. 

F.  SUMMARY 

Our  review  of  benefits  provided  by  RAC  confirmed  the  pattern  observed  at  CBIAC 
and  GACIAC.  Although  we  did  not  systematically  review  core  products  and  services 
available  on  general  distribution,  those  users  we  contacted  in  connection  with  special  tasks 
or  individual  response  core  programs  told  us  that  they  were  well  served  by  RAC 
information  products.  Frequently,  we  were  told  there  were  no  alternative  sources  for 
comparable  information. 
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A  large  number  of  the  individual  response  core  product  users  were  able  to 
characterize  the  benefits  they  received  from  using  RAC  information  products  and  services. 
Table  6-14  summarizes  these  results. 


Table  6*14.  RAC  Cora  Information  Products  and  Services* 


Qualitative  Benefit 

#  of  Tasks 
Reporting  Benefit 

No  Defined  Qualitative  Benefit 

8 

Verification/Substantiation 

14 

Objectivity  SNeutral  Competence 

3 

Enhanced  Productivity 

9 

Standards  and  Standardization 

0 

Enhanced  Communication 

0 

Enhanced  Competitiveness 

3 

Enhanced  Military  CaDability 

2 

*  The  total  number  of  benefit  types  reported  exceeds  sample  size  due 
to  multiple  benefit  types  for  several  tasks. 


RAC  special  task  users  interviewed  in  this  study  had  similar  problems  in 
quantifying  the  benefit  resulting  from  use  of  RAC  for  information  analysis  and  technical 
assistance.  Several  interviewees  were  able  to  describe  and  document  quantitative  benefits 
resulting  from  use  of  RAC.  The  data  in  Table  6-15  reiterates  data  presented  in  Table  6-10 
above. 


Table  6-15.  Quantitative  Benefits  From  RAC  Special  Tasks 


IAC 

#  of  Tasks 
with  Benefit 

Data 

Total  Cost  of 
Benefit  Data 

Taaka 

i 

| 

#  of  Taska 
Quantified 
Banaflts 

Coat  of 
Quantified 
Benefits  Task# 

Quantified 

Value  of 
Benefits 

Benefit  Calculation 
Method 

RAC 

8 

$1,918,000 

3 

$1,225,500 

>$15,330,000 

•  LOWER  LABOR  RATES 
« COST  AVOICANCE 

BY  AVOIDING 

OF  AMMO  PLANT 

•  IMPROVED  RELIABILITY 
OF  MILSTAR  SYSTEMS 

RAC  special  task  users  were  also  able  to  describe  qualitative  benefits  resulting  from 
their  use  of  RAC.  A  summary  of  this  information  is  presented  below  in  1-Cle  6- 16. 
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Table  6*16.  Quantitative  Benefits  of  Selected  IAC  Special  Tasks 


IAC 

QUALITATIVE  BENEFIT 

EXAMPLE 

RAC 

IMPROVED  CAPABILITY 

NAVAL  AVIONICS 

AIR  FORCE  EW  POD 

RELIABILITY  CENTERED  MAINTENANCE 

FOR  MARINE  CORPS  VEHICLES 

LONG  TERM  SUSTAINABILITY 

FAA  TERMINAL  AREA  SURVEILLANCE 

On  the  basis  of  our  sample,  it  appears  that  RAC  is  providing  to  DoD  benefits  in  its 
special  studies  program  valued  approximately  15  times  their  cost.  This  special  task  benefit 
cost  ratio  is  substantially  higher  than  other  IACs  examined.  As  noted  earlier,  RAC  special 
task  users  tend  to  be  organizations  which  are  dealing  with  systems  either  in  advanced 
development  or  already  fielded.  RAC  provides  information  analysis  and  data  which  bear 
on  operations  and  maintenance.  As  a  result  there  are  tangible  costs  and  calculable  savings 
based  on  costs  that  would  have  been  incurred  had  RAC  not  provided  information  which 
allowed  the  developer  or  the  operator  to  change  customary  and  usual  practices. 


7.  SUMMARY  AND  CONCLUSIONS 


A.  INTRODUCTION 

This  report  has  presented  the  results  of  IDA's  evaluation  of  benefits  provided  to 
DoD  by  a  representative  of  DoD  Information  Analysis  Center.  EDA  examined  uses  of 
information  provided  by  the  Chemical  Warfare/Biological  Defense  Information  Analysis 
Center  (CBIAC)  during  the  period  1987-1988,  the  Tactical  Weapon  Guidance  and  Control 
Information  Analysis  Center  (GaCIAC)  during  the  period  1986- 1988,  and  the  Reliability 
Analysis  Center  during  the  period  1986-1988.  The  study  examined  information  provided 
under  both  the  core  program  and  special  tasks. 

The  EDA  study  sought  to  answer  two  key  questions: 

•  Do  DoD  Information  Analysis  Centers  provide  benefits  to  DoD  and  its 
contractors? 

♦  If  DoD  Information  Analysis  Centers  do  in  fact  provide  benefits,  can 
improvements  in  IAC  program  policy,  administration,  management,  and 
oversight  be  made  to  increase  the  benefits  to  DoD  and  its  contractors? 

IDA  was  also  asked  to  quantify,  if  possible,  rny  benefits  to  DoD  provided  by  IACs 
identified  in  this  study.  IDA  was  also  asked  to  report  on  the  benefits  in  a  manner  that  might 
lend  itself  to  use  in  program  and  budget  discussions  within  the  Pentagon  and  the  legislative 
process. 

This  report  presents  the  results  of  our  effort  to  identify  and  quantify  where  feasible 
the  benefits  to  DoD  provided  by  DoD  Information  Analysis  Centers. 

B .  BENEFITS  OF  CORE  IAC  INFORMATION  PRODUCTS  AND 
SERVICES 

Due  to  problems  of  logistics  associated  with  an  interview- based  field  study,  IDA 
elected  to  narrow  the  range  of  IAC  users  from  the  entire  universe  to  a  more  manageable 
sample.  In  the  case  of  core  program  information  products  and  services,  we  focused  on 
those  users  who  ordered  individually  prepared  information  items  from  CBIAC  GACIAC, 
and  RAC.  Such  items  often  took  the  form  of  bibliographies,  referrals  to  other  sources  of 


information,  data  sets,  data  books,  or  answers  to  technical  inquiries.  We  devoted  most  of 
our  conversations  and  interviews  with  recent  core  users  of  the  three  IACS.  This  simplified 
our  data  collection  somewhat.  It  also  put  us  in  contact  with  users  who  had  reasonably 
fresh  memories  of  the  information  provided  by  their  utilization  of  it 

1 .  Core  Product  and  Service  Selection 

We  examined  records  of  individual  responses  at  CBIAC,  GACIAC,  and  RAC  and 
were  able  to  locate  individual  names  and  addresses  to  survey.  Table  7-1  summarizes  the 
tot  d  number  of  core  program  individual  response  items  examined  for  potential 
interviewees. 


Table  7-1.  Potential  Population  of  Individual  Response 
Core  Program  Information  Products  and  Services 


1AC 

#  of  Products 

CBIAC 

323 

GACIAC 

283 

RAC 

92 

Table  7-2  summarizes  the  number  of  individual  response  core  information  products 
for  each  LAC  by  type  of  product  on  which  we  based  our  assessment  of  individual  response 
core  information  product  or  services  benefits. 


Table  7-2.  Sample  Individual  Response  Items 
Identified  by  Three  lACs  for  FY  1933 


IAC 

Inquiries 

Other  Core  Services 

CBIAC 

— 

23 

39 

22 

GACIAC 

9 

0 

47 

RAC 

0 

10 

23 

As  noted  in  the  body  of  this  report,  one  cannot  infer  that  GACIAC  answered  no 
technical  inquiries  or  RAC  provided  no  bibliographies  in  1983.  Rather,  we  were  unable  to 
contact  any  users  who  had  received  these  products  or  services. 


2.  Core  Product  and  Service  Quantitative  Benefits 

On  balance,  we  found  that  core  program  users  had  a  great  deal  of  difficulty 
quantifying  the  benefits  of  information  provided  by  CBIAC,  GACIAC,  and  RAC.  Eight 
CBIAC  core  program  information  consumers  reported  that  during  calendar  year  1988  they 
had  saved  in  excess  of  $565,000.  This  judgment  was  based  on  the  estimated  costs  of 
obtaining  information  equivalent  to  that  provided  by  CBIAC  by  other  means  (materials 
testing)  or  from  other  sources.  One  GACIAC  user  reported  a  benefit  of  using  GACIAC  to 
prepare  a  bibliography  in  terms  of  man-days  saved.  This  user  did  not  translate  the  savings 
in  labor  hours  to  savings  in  dollars.  One  RAC  core  user  reported  saving  approximately 
$850  by  relying  on  RAC  to  provide  documents  which  could  otherwise  be  obtained  but  at 
higher  cost  and  considerable  delay. 

3.  Core  Program  Qualitative  Benefits 

We  did  find  that  most  core  program  users  could  describe  in  fairly  rigorous  terms  a 
broad  range  of  qualitative  benefits  they  obtained  by  turning  to  DoD  IACs.  Table  7-3 
summarizes  the  number  of  times  an  LAC  user  identified  a  qualitative  benefit  obtained  from 
CBIAC,  GACIAC,  or  RAC.  The  reader  is  reminded  that  several  users  reported  multiple 
qualitative  benefits  from  their  individual  response  information  item. 


Table  7-3.  Qualitative  Benefits  of  Representative  Sample  DoO  IAC 
Individual  Response  Information  Items 


Benefit  Category 

CBIAC 

GACIAC 

RAC 

No  Defined  Qualitative  Benefit 

11 

36 

8 

Verification/Substantiation 

22 

3 

14 

Objectivity  &  Neutral  Competence 

9 

1 

3 

Enhanced  Productivity 

44 

11 

9 

Standards  and  Standardization 

6 

0 

0 

Enhanced  Communication 

4 

11 

0 

Enhanced  Competitiveness 

8 

2 

3 

Enhanced  Military  Capability 

7 

3 

2 

Total  #  of  Tasks  Examined 

75 

50 

33 
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At  the  macro  level  of  analysis,  the  core  users  with  whom  we  spoke  were  generally 
able  to  identify  a  qualitative  benefit  from  relying  on  one  of  the  DoD  IACs  included  in  our 
representative  sample.  On  further  analysis,  it  appears  that  the  core  program  at  each  IAC  is 
in  fact  accomplishing  one  of  the  primary  purposes  of  IAC  program  as  a  whole-promoting 
the  exchange  and  dissemination  of  scientific  and  technical  information  in  fields  of  science 
and  technology  in  which  DoD  maintains  a  significant  programmatic  thrust 

C.  SPECIAL  TASK  BENEFITS 

1 .  Special  Task  Selection  and  Review 

Our  study  also  sought  to  identify  both  quantitative  and  qualitative  benefits  to  DoD 
accruing  from  the  use  of  CBLAC,  GACLAC,  and  RAC.  We  examined  a  listing  of  special 
tasks  placed  at  each  IAC  for  the  most  recent  contract  fiscal  years.  We  then  selected 
candidate  special  task  users  to  be  interviewed  for  our  study  to  assess  the  benefits  of  DoD 
IACs.  We  commenced  to  interview  identified  users  in  as  many  locations  as  could  be 
visited  within  the  time  and  resource  constraints  of  the  task.  Table  7-4  summarizes  the 
success  we  enjoyed  in  reviewing  special  tasks  for  each  IAC  in  this  study. 


Table  7-4.  Coverage  of  Special  Task3  by  Representative  Sample  Study 


IAC 

9 

■K 

■ 

H 

91 

Total  Tasks 

GAC1AC 

FY  86-88 

100  % 

100% 

75% 

94% 

100% 

100% 

CBIAC 

FY  87-88 

100% 

100% 

CD 

—4 

9^ 

83% 

42% 

59% 

RAC 

FY  86-88 

50% 

91% 

UBS 

50% 

75% 

90% 

We  were  generally  very  successful  in  locating  special  tasks  requiring  activities  and 
individuals  who  were  at  least  familiar  with  the  results  of  the  IACs'  special  tasks  if  not  the 
originator  of  such  tasks.  As  a  result,  we  were  provided  with  very  good  information  about 
the  tasks,  the  results  of  the  tasks,  the  changes  in  requiring  activity  procedures,  programs, 
or  policies  that  resulted  from  the  tasks,  and  the  quantitative  and/or  qualitative  benefits  as 
perceived  by  the  users. 
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As  a  sidelight,  we  were  better  able  to  understand  the  variability  among  the  IACs  in 
their  user  communities  by  vinue  of  funding  categories  associated  with  the  funds  for  special 
tasks.  Table  7-5  summarizes  the  budget  categories  of  funds  placed  at  CBIAC,  GACIAC, 
and  RAC  in  support  of  special  tasks. 


Table  7-5.  Budget  Categories  of  Special  Studies  Performed  by  Three  OoD  IACs 


Budget 

Cateaofy 

BfSl 

TOTAL 

Unknown 

8 

3 

10 

a 

1 

2 

28 

6.1 

4 

4 

6.2 

B 

6 

1 

11 

22 

6.3A 

a 

5 

3 

10 

2 

1 

25 

6.3B 

1 

1 

2 

1 

5 

6.4 

2 

a 

2 

8 

O&M 

1 

1 

2 

Procurement 

1 

1 

1 

3 

The  data  suggest,  but  do  not  unequivocally  prove,  that  CBIAC,  GACIAC  and  RAC 
have  somewhat  different  customer  bases.  GACIAC  appears  to  have  much  of  its  strength  in 
the  6.2  and  6.3A  development  community.  CBIAC  seems  to  have  considerable  strength  in 
the  6. 1  and  6.2  advanced  research  and  exploratory  development  community.  RAC  seems 
to  have  a  strong  market  for  its  information  products  and  services  in  the  O&M  and 
procurement  communities. 

In  aggregate,  however,  the  data  suggest  that  these  three  IACs  are  generally 
providing  the  bulk  of  their  support  to  the  R&D  community,  consistent  with  the  direction 
provided  by  the  IAC  Regulation. 

2.  Special  Task  Quantitative  Benefits 

The  study  attempted  to  identify  both  quantitative  and  qualitative  benefits  to  DoD 
resulting  from  the  use  of  DoD  IACs.  The  choice  of  DoD  IACs  as  a  source  of  information, 
analysis,  and  technical  assistance  made  by  special  task  users  suggests  an  implicit  judgment 
by  special  task  customers  that  IACs  offer  at  least  benefits  equal  if  not  greater  than  the  cost 
of  special  tasks.  Table  7-6  illustrates  that  in  several  instances,  special  task  users  of 
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CBIAC,  GACLAC  and  RAC  were  able  to  either  document  or  provide  information  enabling 
the  IDA  study  team  to  calculate  quantitative  benefits  for  several  special  tasks. 


Table  7-6.  Quantitative  Benefits  From  Selected  DOD  IACS 


IAC 

#  of  Tasks 
with  Benefit 

Data 

Tolal  Cost  of 
Tasks 

Quantlflad 

Valus  of 
Bsnsflts 

Bansflt  Calculation 
Mathod 

#  of  Tasks 
Quantlflsd 
Bsnsflts 

C03t  of  Tasks 
with  Quantlflad 
Bsnsflts 

CBIAC 

32 

$4,263,000 

$1,407,500 

•  LOWER  LABOR  RATES 
•  DEFERRED  PROCUREMENT 

5 

$431,000 

GACIAC 

14 

$5,286,000 

$5,045,000 

•  LOWER  LABOR  RATES 

•  REDUCTION  IN  FIELD 

TEST  TIME 

•  ACCELERATION  OF  R&D 

5 

$1,642,000 

RAC 

8 

$1,516,000 

>$15,330,000 

•  LOWER  LABOR  RATES 
•COST  AVOIDANCE 

8Y  AVOIDING 

OF  AMMO  PLANT 
•  IMPROVED  RELIABILITY  OF 
MILSTAR  SYSTEMS 

3 

$1,225,500 

We  found  that  many  special  task  users  of  CBIAC,  GACIAC,  or  RAC  had  great 
difficulty  in  quantifying  the  benefits  resulting  from  their  use  of  the  IACs.  When  users  were 
able  to  present  their  quantification  of  benefits  or  sufficient  data  to  allow  us  to  quantify  the 
benefits,  we  saw  considerable  benefits.  In  the  case  of  CBIAC,  most  of  the  quantifiable 
benefits  were  the  result  of  lower  labor  rates  or  cost  avoidance  as  a  result  of  a  specific 
special  task.  In  the  case  of  GACIAC,  the  IAC  had  developed  several  analytical  tools  and 
techniques  which  will  result  in  recurring  savings  to  the  user  community.  The  development 
of  a  terrain  model  of  the  Pacific  Missile  Test  Center  and  its  subsequent  use  in  test  mission 
planning,  range  instrumentation  modernization,  and  test  operations  will  result  in  recurring 
savings  estimated  by  the  Navy  at  several  million  $  per  year. 

In  the  case  of  RAC,  three  tasks  resulted  in  benefits  which  would  be  measured 
quantitatively.  RACs  contribution  to  the  Army’s  ammunition  plant  modernization  program 
was  very  dramatic.  The  Army  officials  with  whom  we  spoke  credited  RAC  with 
development  and  implementation  of  the  process  control  technology  at  new  Army 
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0 


0 


0 


0 


0 


ammunition  plants  which  obviated  the  need  for  $2.1  billion  in  new  construction.  While  the 
Army  credited  RAC  with  savings  in  excess  of  $200  million,  EDA  partitioned  the  savings 
among  all  contractors  and  Army  organizations  participating  in  the  ammunition  plant 
modernization  program.  RACs  share  of  the  $200  million  plus  benefit  was  calculated  by 
IDA  at  approximately  $9  million.  Similarly,  the  program  manager  for  the  MILSTAR 
program  credited  RAC  with  saving  the  program  $6  to  $10  million  per  year  over  the  life  of 
the  program  once  the  satellites  arc  in  production.  IDA  elected  to  credit  RAC  with  a  one¬ 
time  savings  of  $6  million. 

While  it  is  not  possible  to  develop  a  general  benefit-cost  ratio  for  all  IAC  special 
tasks,  we  found  that  where  it  was  possible  to  calculate  both  direct  contract  or  task  costs  for 
special  tasks  on  the  one  hand  atid  quantify  benefits  on  the  other,  the  benefit-cost  ratio  for 
the  three  IACs  examined  u  this  portion  of  our  study  was  as  follows: 

CBIAC  3.3  to  1 

GAOAC  3.1  to  1 

RAC  12.5  to  1 

3.  Special  Task  Qualitative  Benefits 

Although  many  special  task  users  could  not  quantify  the  benefits  of  using  CBIAC, 
GACIAC,  or  RAC,  most  could  idertify  discrete  qualitative  benefits  which  in  their  mind 
equaled  or  exceeded  the  costs  of  their  special  tasks.  Table  7-7  summarizes  the  qualitative 
benefits  reported  to  the  EDA  study  team. 

Each  IAC  included  in  this  phase  of  our  study  had  at  least  one  special  task  user  who 
could  identify  a  change  in  the  operation  of  existing  military  forces  which  improved  U.S. 
combat  capability.  We  were  surprised  to  sec  R&D-funded  efforts  contributing  directly  to 
improved  operational  capability  with  no  additional  investment  of  procurement  or  O&M 
funds.  CBIAC  and  GACIAC  were  also  credited  by  several  special  task  users  as  playing 
significant  roles  in  the  improvement  of  military  training.  CBIAC  and  GACIAC  were 
credited  with  improving  R3tD,  especially  as  a  result  of  the  sponsorship  of  classified 
meetings.  These  meetings  provide  a  forum  in  which  data  can  be  collected,  analyzed, 
shared,  and  ultimately  reduced  to  proceedings  which  then  become  the  basis  for  further 
study  and  analysis.  CBIAC  and  GACIAC  users  felt  that  such  meetings  were  essential  to 
the  enhanced  flow  of  scientific  and  technical  information  and  the  acceleration  of  RAD 
throughout  the  communities  served  by  these  IACs. 
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Tab!#  7-7.  Qualitative  Benefits  of  Selected  IAC  Special  Tasks 


IAC 

QUALITATIVE  BENEFIT 

EXAMPLE 

C8IAC 

IMPROVED  CAPABILITY 

•  AIR  BASE  DEFENSE 

•  AIR  BASE  OPERABILITY 

•  ARMY  CW  DETECTORS 

•  TANK  CREW  PROTECTION 

IMPROVED  TRAINING 

•  NAVY  CW  TRAINING 
•  AIR  FORCE  MASK  TRAINING 

IMPROVED  R3D  PLANNING 

•  NAVY  CW/BW  6.2  PROGRAM 

•  ARMY  CHEMICAL  DEMIL  PROGRAM 

•  CHEMICAL  WARFARE  STUDIES 

IMPROVED  TESTING 

•  BIOLOGICAL  DETECTION 

•  SMOKE  AND  OBSCURANTS  PROGRAM 

•  AIR  FORCE  MASK  PROGRAM 

NEUTRAL  COMPETENCE 

•  EDGEWOOD  A 3.E  REVIEWS 

•  BIOLOGICAL  DEFENSE  PROGRAM 

ENVIRONMENTAL  IMPACT  STATE¬ 
MENT  PROCESS 

GACIAC 

IMPROVED  CAPABILITY 

•  AEGIS  EC  CM/E  SM  PROGRAM 

♦  STINGER  MODEL 

•  E-O  MODELING/COUNTERMEASURES 

IMPROVED  TESTING 

•  AEGIS  TESTING/ASM  TESTING 
•  ARMY  ANTI-AIR  1  ESTiNG 

•  ADVANCED  AF  MATERIALS  TESTING 

IMPROVED  R&D  PLANNING 

•  SAM/AAW  SYSTEMS  TESTING 

MATERIALS  FOR  SENSORS 

•  NEW  SENSOR  MATERIALS  FOR  AF 

ACCELERATED  R&D 

MATERIALS  LABORATORY 
•  IMPROVED  ANTI-ARMOR 

TEST  PROGRAM 

RAC 

IMPROVED  CAPABILITY 

•  NAVAL  AVIONICS 

•  AIR  FORCE  EW  PCD 

•  RELIABILITY  CENTERED 
MAINTENANCE  FOR  MARINE  CORPS 

VEHICLES 

LONG  TERM  SUSTAINABILITY 

•  FAA  TERMINAL  AREA  SURVEILLANCE 

I 


^  D.  SUMMARY  AND  CONCLUSIONS 

We  therefore  conclude  this  phase  of  our  study  with  the  finding  that  core  and  special 
task  u^rs  of  CBIAC,  GACIAC,  and  RAC  are  obtaining  a  wide  range  of  benefits  from  the 
use  of  the  IAC.  In  each  IACs  case,  the  quantitative  benefits  derived  from  core  use  are 
I  relatively  small;  however,  the  quantitative  benefits  from  special  task  use  of  the  IACs  are 

quite  substantial. 

We  also  found  that  the  qualitative  benefits  from  both  core  and  special  task  use  of 
CBIAC,  GACIAC,  and  RAC  are  quite  significant  Each  IAC  has  contributed  to  improved 
&  operational  capability  of  existing  military  forces;  each  has  contributed  to  improvements  in 

the  training  of  U.S.  military  personnel;  all  have  been  credited  with  improvements  in  R&D 
productivity. 

Having  concluded  that  DoD  is  benefiting  from  the  Information  Analysis  Centers 
Program  in  its  configuration  circa  1987-1989,  our  study  turned  to  an  examination  of 
program  administration,  management,  and  oversight.  These  topics  are  addressed  in 
another  IDA  Paper  available  to  U.S.  Government  personnel  and  authorized  contractors 
entitled.  Evaluation  of  DoD  Information  Analysis  Centers  Program:  Representative  Sample 
Study;  IAC  Program  Implementation. 
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FOREWORD 

This  Regulation  is  issued  under  the  authority  of  DoD  Directive 
3200. i' 2,  "Defense  Scientific  and  Technical  Information  Program,"  February 
15,  1583.  It  replaces  and  cancels  DoD  Instruction  5100.45,  "Centers  for 
Analysis  of  Scientific  and  Technical  Information,"  July  28,  1964.  This 
Regulation  applies  to  only  those  centers  whose  primary  purpose  is  to  provide 
analytical  and  evaluative  support  to  defense  research,  development,  and 
acquisition  programs  and  whose  basic  operating  funds  are  appropriated  for 
research,  development,  test,  and  evaluation. 

The  provisions  of  this  Regulation  apply  to  the  Office  of  the  Secretary 
of  Defense,  the  Military  Departments,  and  the  Defense  Agencies  (hereafter 
referred  to  as  "DoD  Components").  This  Regulation  prescribes  procedures  to 
be  followed  by  all  DoD  Components  in  establishing,  operating,  and 
administering  centers  for  Analysis  of  Scientific  and  Technical  Information 
(hereinafter  referred  to  as  Information  Analysis  Centers)  within  the 
framework  of  the  DoD  Scientific  and  Technical  Information  Program. 

This  Regulation  is  effective  immediately  and  is  mandatory  for  use  by 
all  DoD  Components.  Heads  of  DoD  Components  may  issue  supplementary 
instructions  only  when  necessary  to  provide  for  administration  of  this 
Regulation  within  their  respective  Components.  Send  recommended  changes 
to  the  Regulation  through  channels  to: 

Director,  Research  and  Laboratory  Management 

Office  of  the  Deputy  Under  Secretary  of  Defense  (Research  and 
Advanced  Technology)  ~ 

The  Pentagon,  Room  3E114 

Washington,  D.C.  20301-3081 

DoD  Components  may  obtain  copies  of  this  Regulation  through  their 
own  publication  channels.  Other  Federal  agencies  and  the  public  may  obtain 
copies  from  the  Director,  U.S.  Naval  Publications  and  Forms  Center,  5801 
Tabor  Avenue,  Philadelphia,  Pennsylvania  19120. 

OoJl,  ^  . 

James  P.  Wade,  Jr. 

Acting 

Under  Secretary  for 

Research  and  Engineering 
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DEFINITIONS 


1.  Analysis.  A  qualitative  or  quantitative  information  evaluation  requiring 
technical  knowledge  and  judgement. 

2.  Centers  for  Analysis  of  Scientific  and  Technical  Information.  A  formal 
organization  with  a  primary  mission  to  acquire,  digest,  analyze,  evaluate, 
synthesize,  store,  publish,  and  provide  advisory  and  other  user  services 
concerning  available  worldwide  scientific  and  technical  information  and 
engineering  data  in  a  clearly  defined,  specialized  field  or  subject  area  of 
significant  DoD  interest  or  concern.  Information  Analysis  Centers  (IACs)  are 
distinguished  from  technical  information  centers  and  libraries  whose  functions 
primarily  are  concerned  with  providing  reference  or  access  to  the  documents 
themselves  rather  than  the  information  contained  in  the  documents. 

3-.  Data.  Any  representation  such  as  characters  or  analog  quantities  to  which 
meaning  may  be  assigned.  Data  may  be  expressed  in  digital,  graphic,  electronic, 
or  symbolic  form. 

4.  Scientific  and  Technical  Information  (STI).  Communicable  knowledge  or 
information  resulting  from  or  pertaining  to  conducting  and  managing  Research, 
Development,  Test  and  Evaluation  (RDT&E)  efforts.  STI  is  used  by  administra¬ 
tors,  managers,  scientists,  and  engineers  engaged  in  scientific  and  techno¬ 
logical  efforts  and  is  the  basic  intellectual  resource  for  and  result  of  such 
effort.  Throughout  this  Regulation  the  term  information  shall  mean  specifically 
STI  and  may  not  be  construed  to  mean  scientific  and  technical  intelligence. 

5.  Sponsoring  DoP  Component.  The  DoD  agency  that  provides  basic  operating 
funds  and  administrative  direction  for  a  given  IAC. 

6.  Technical  Advisory  Group.  A  group  of  technical  experts  chosen  to  advise 
and  monitor  the  activities  of  a  given  IAC. 

7.  Technical  Monitor.  The  Government  technology  specialist  or  project 
engineer  providing  continuous  technical  direction  and  oversight  for  the  IAC. 
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CHAPTER  1 

THE  DoD  PROGRAM  FOR  INFORMATION  ANALYSIS  CENTERS 


A.  POLICY 


1.  In  recognition  of  the  important  and  integral  part  that  information 
analysis  and  evaluation  activities  play  in  the  research  and  development  process, 
the  Department  of  Defense  shall  endorse  institutionalization  of  these  activities 
in  the  form  of  information  analysis  centers  (IACs)  when  sufficient  requirements 
or  benefits  are  established. 

2.  DoD  IACs  shall  be  established  primarily  to  support  the  Department  of 
Defense.  They  may  serve  the  private  sector  to  the  extent  practicable  within 
DoD  security  guidelines  and  DoD  policy  regarding  the  handling  of  information  on 
military  critical  technologies.  Applicable  DoD  security  guidelines  include  DoD 
Regulations  5200. 1-R  (reference  (a))  and  5220. 22-R  (reference  (b)). 

3.  IACs  will  not  receive,  process,  or  disseminate  scientific  and  technical 
intelligence. 

4.  Each  IAC  shall  maintain  a  staff  of  technical  experts  in  its  field  of 
specialization.  The  center  shall  be  attached  to  or  have  a  working  relationship 
with  a  private  sector  or  DoD  organization  engaged  in  technical  work  related  to 
its  mission  and  may  seek  assistance  from  qualified  experts  employed  by  that 
organization. 

5.  Each  IAC  shall  be  administered  by  a  single  sponsoring  DoD  Component  to 
be  designated  by  the  Under  Secretary  of  Defense  for  Research  and  Engineering 
(LoDR&E)  in  accordance  with  DoD  Directive  32C0.12  (reference  (c)). 

6.  Classified  information  shall  be  receipted,  controlled,  disposed  of, 
and  protected  fr.  *>  unauthorized  disclosure  in  accordance  with  the  provisions 
of  DoD  Regulation  i200.1-R  (reference  (a))  and  DoD  Regulation  5220. 22R 
reference  (b)). 

7.  Publication  and  release  of  technical  information  shall  be  in  accordance 
with  DoD  regulations  including  DoD  5200. 1-R  (reference  (a)).  Documents  con¬ 
taining  classified  information  shall  be  issued  in  accordance  with  DoD  release 
and  security  directives  contained  in  reference  (a)  and  (b)  after  they  have  been 
reviewed  and  approved  by  responsible  technical  5nd  security  authorities. 

8.  IACs  shall  be  aware  of  and  shall  observe  all  current  export  control 
lists  and  licensing  procedures  as  established  by  the  Department  of  State, 

United  States  Munitions  List;  The  Department  of  Commerce,  Commodity  Control 
List;  and  the  Department  of  Energy,  Atomic  Energy  Act.  IACs  shall  epsure  that 
all  personnel  understand  fully  these  lists  and  procedures,  and  centers  shall 

be  prepared  to  act  whenever  necessary  to  ensure  that  these  lists  and  procedures 
are  respected. 

9.  In  the  case  of  contractor  operated  IACs,  the  Technical  Monitor  shall 
provide  technical  guidance  to  the  IAC,  with  the  assistance  of  an  ad  hoc 
technical  advisory  group  appointed  by  the  Technical  Monitor.  In-house  IACs 
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shall  have  their  activities  monitored  by  an  ad  hoc  technical  advisory  group 
recommended  by  the  manager  of  the  IAC  and  approved  by  the  focal  point  of  the 
sponsoring  DoD  Component  for  the  IAC  concerned. 

10.  DoD  IACs  shall  establish  mechanisms  for  cooperation  and  cross¬ 
fertilization  of  ideas  on  management  philosophy,  policy,  promotion,  operating 
procedures,  and  other  areas  of  mutual  interest.  Meetings  of  all  DoD  IAC 
managers,  technical  monitors,  and  sponsors  shall  be  held  for  the  purpose  of 
information  exchange  in  these  areas. 


B.  RESPONSIBILITIES 


1. 

shall: 


The  Under  Secretary  of  Defense  for  Research  and  Engineering  (USDR&E) 


a.  Maintain  overall  management  control  of  the  DoD  STI  Program  in 
accordance  with  DoD  Directive  3200.12  (reference  (c)). 

b.  Approve  or  disapprove  all  proposals  by  the  heads  of  DoD  Com¬ 
ponents  involving  the  establishment  of  new  IACs,  major  changes  in  an  IAC's  scope 
or  subject  area,  or  disestablishment  of  an  IAC. 


Monitor. 


Appoint  a  technology  specialist  to  each  DoD  IAC  as  Technical 


2.  The  Director,  Research  and  Laboratory  Management  0USDR&E  (Research  and 
Advanced  Technology  (R&AT))  or  his  designee  shall: 

a.  Centrally  monitor  the  DoD  IAC  program  and  establish  mechanisms 
to  promote  standardization  among  the  programs  to  the  DoD  Components  regarding 
procurement  practices  and  interagency  operations,  the  development  of  standard 
performance  measurement,  and  reporting  criteria. 


biennially. 


b.  Appoint  an  ad  hoc  review  board  to  review  each  IAC  at  least 


3.  The  Sponsoring  DoD  Comoonent  shall: 


a.  Provide  continuous  administrative  and  operational  management 

for  the  IAC  assigned.  Designated  in-house  DoD  IACs  are  assigned  to  the  proposing 
Defense  Agency  or  Military  Service  33  approved  by  the  USDR&E. 

b.  Prepare  and  defend  programs  and  budgets  consistent  with  annual 
budget  cycles  and  USDR&E  requirements  for  each  assigned  IAC. 

c.  Establish  USDR&E- approved  IACs  through  procurement  of  contract 
services  or  direct  in-house  establishment,  as  appropriate. 


d.  Review  performance  of  the  IACs  in  coordination  with  the  Technical 
Monitor  and  the  Director,  Research  and  Laboratory  Management,  0USDR&E  (R&AT) 
to  assess  continuing  need  and  approve  program  changes  as  necessary  to  improve 
performance. 
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4.  The  Technical  Monitor  shall: 

a.  Provide  continuous  technical  direction  and  oversight  for  the 
IAC  assigned. 

b.  Assess  technical  subject  requirements  and  adequacy  of  literature 
coverage  by  the  IAC  for  the  DoD  users. 

c.  Evaluate  and  approve  IAC  proposals  for  products  and  services 
from  the  technical  standpoint. 

d.  Be  a  Government  employee  and  not  a  member  of  the  IAC  staff. 
Synonymous  titles  are  Technical  Manager,  Government  Project  Engineer,  and 
Contracting  Officer's  Technical  Representative  (COTR). 

e.  Provide  the  technical  requirements  input  for  the  Statement  of 
Work  for  contractor-operated  IACs. 
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CHAPTER  2 

ESTABLISHMENT  AND  DISESTABLISHMENT  OF  DOD 
INFOkMATION  ANALYSIS  CENTERS 

A.  ESTABLISHMENT  OF  IACs 

1.  Proposals  from  DoD  Components  for  establishment  of  an  IAC  shall  be 
processed  through  the  same  channels  that  are  used  to  approve  and  authorize 
any  other  RDT&E  program. 

2.  Approval  shall  be  based  on,  but  not  limited  to,  the  following 
criteria: 


a.  Documented  evidence  of  a  requirement  to  fill  a  void  in  an 
emerging  DoD  technology  thrust  area. 

b.  Clear  definition  of  subject  fields  to  be  covered  and  demonstra¬ 
tion  that  other  IACs  or  sources  do  not  duplicate  the  proposed  IAC. 

* 

c.  Cost  and  effectiveness  and  evaluation  of  alternate  ways  of 
accomplishing  the  objectives  of  the  IAC. 

d.  Adequate  financial  support  and  plans  for  continuing  support  to 
achieve  the  announced  objectives  of  the  IAC. 

e.  Active  support  of  the  IAC  by  persons  engaged  in  the  type  of 
technical  work  to  be  covered  by  the  IAC*s  information  products. 

f .  Evidence  of  capability  to  enforce  proper  security  procedures 
and  controls  on  technology  transfer. 

3.  Subject  Coverage.  Subject  areas  covered  by  an  IAC  may  be  determined 
from  one  or  both  of  the  following  categories: 

a.  Discipline-Oriented  Coverage.  This  information  pertains  to  all, 
or  a  clearly  defined  part  of,  a  recognized  scientific  or  engineering  discipline, 
which  has  its  own  literature  or  professional  traditions. 

b.  Mission-Oriented  Coverage.  This  information  pertains  to  a  mili¬ 
tary  undertaking  of  special  interest  to  the  Department  of  Defense  or  to  a 
specific  large  weapon  or  its  support  system  or  a  group  of  such  systems,  and 
therefore,  an  area  that  requires  an  interdisciplinary  approach. 

4.  Size  and  Location 


a.  No  specific  limitations  are  imposed  concerning  the  size  of  an 
IAC  as  long  as  the  functions  described  in  Definitions  (page  iv)  can  be  ' 
accomplished. 


b.  IACs  may  be  located  at: 
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1.  DoD  installations,  laboratories,  and  activities. 

2.  Contractor  installations  (educational  institutions, 
industrial  firms,  and  not-for-profit  institutions). 

5.  Security.  IAC3  will  satisfy  all  physical  and  document  security 
requirements,  as  set  forth  in  applicable  and  referenced  DoD  directives,  for 
the  protection  of  classified  information  stored  or  held  therein. 

B.  DISESTABLSHMENT  OF  IACs 


1.  A  combination  of  factors  may  fora  the  basis  for  a  decision  to 

recoMend  disestablishment  of  an  IAC.  Following  a  complete  review,  the  USDR&E  , 

will  make  the  decision  concerning  disestablishment  of  an  IAC.  The  following 
are  typical  of  questions  that  may  be  considered  in  pondering  such  a  decision. 

a.  Is  the  IAC  still  functioning  in  a  major  DoD  technology  thrust 

area? 

b.  Is  the  IAC  demonstrably  useful  to  the  Department  of  Defense?  ' 

c.  Is  the  IAC  fulfilling  a  DoD  need  that  is  not  duplicated  by  other 

public,  private,  or  government  organizations? 

d.  What  is  the  value  of  products  or  services  to  users  with  respect 

to  current  DoD  programs?  4 

e.  Are  funds  available? 

f.  Is  the  IAC  maintaining  proper  security  controls  and  controls 
over  transfer  of  technology  to  foreign  individuals  and  organizations? 

2.  After  the  USLR&E  has  decided  to  disestablish  an  IAC,  the  following  shall 
be  accomplished: 

a.  Tbe  sponsoring  DoD  Component  shall  announce  a  termination  date 
at  least  90  days  before  the  termination  date  and  shall  require  the  managing 
supervisor  of  the  IAC  to  provide  a  written  inventory  of  the  IAC's  holdings. 

4 

b.  The  sponsoring  department  or  agency  shall  decide  the  disposition 
of  the  IAC's  holdings  with  the  assistance  of  the  managing  supervisor  of  the 
IAC  and  the  approval  of  USDR&E. 
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CHAPTER  3 

OPERATION  OF  DOD  INFORMATION  ANALYSIS  CENTERS 


a 


9 


9 


9 
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A.  POLICY 

1.  Basic  IAC  operations,  as  defined  by  the  sponsoring  DcD  Component, 
shall  be  supported  by  DoD  funds. 

2.  IACs  shall  assist  in  advancing  standardization  of  the  technology 
in  the  IAC's  special  field  of  expertise. 

3.  IACs  shall  make  optimal  use  of  cost-effective  new  and  advanced 
technologies,  such  as  computers,  telecommunications ,  ana  word  processing,  in 
operation  of  their  centers. 

4.  IACs  shall  acquire,  store,  and  disseminate  subject  ar.a  technical 
information  from  appropriate  sources,  domestic  and  foreign,  including  support 
of  approved  information  exchange  programs  with  countries  that  have  agreements 
with  the  United  States.  However,  IACs  will  not  duplicate  the  existing  CoD 
foreign  open-source  scientific  and  technical  intelligence  literature  exploita¬ 
tion  program  or  automated  data  base. 

5.  If  applicable,  IACs  sli&ll  participate  in  programs  designed  for  the 
’transfer  of  technology  in  assigned  areas  of  tecunical  responsibility..  Equally, 
they  shall  ensure  that  such  participation  does  not  lead  inadvertently  to 
unauthorized  transfer  of  technology. 

6.  IAC  personnel  are  authorized  and  encourage  to  plan,  provide  technical 
support  for,  and  participate  in  major  technical  confeierces,  meetings,  or 
symposia  in  their  area  of  technical  specialization.  Sponsorship  and  attendance 
at  meetings  will  be  in  accordance  with  applicable  DoD  regulations  such  as  DoD 
Directive  5200.12  (reference  (d))  including  provision*  on  security  and  on  transfer 
of  technology.  IAC  personnel  shall  maintain  contact  with  senior  investigators 
and  develop  working  relationships  with  technical,  professional,  and  trade 
associations  and  related  technical  groups  to  exchange  information.  Travel 

funds  shall  be  conserved  by  using  meetings  and  conferences  as  an  opportunity 
for  making  known  the  products  and  services  of  the  IAC  and  maintaining  contact 
with  senior  investigators  in  the  specialized  field  of  the  IAC. 

7.  IACa  shall  prepare,  announce,  and  provide  primary  distribution  of 
critical  reviews,  state-of-the-art  reports,  handbooks,  data  cosrpilations ,  lists 
of  technical  experts,  and  other  significant  publications  pertaining  to  their 
assigned  areas  of  technical  specialization.  IACs  shall  respond  to  inquiries 
from  qualified  users  bearing  in  mind  applicable  security  controls  and  restric¬ 
tions  on  transfer  of  technology  to  foreign  individuals  and  organizations. 

8.  With  the  exception  of  scientific  and  technical  intelligence,  classi¬ 
fied  or  special  category  material  may  be  received  by  an  IAC  provided  that  the 
information  is  pertinent  to  the  miisioa  of  the  IAC  *r.d  appropriate  security 
measures  have  been  established. 
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9.  Primary  distribution  of  documents  formally  issued  by  an  IAC,  other 
than  direct  correspondence  in  response  to  inquiries  and  the  annual  reports 
of  the  IACs,  will  include  the  Defense  Technical  Information  Center  (DTIC). 

10.  IACs  will  not  provide  secondary  distribution  for  any  documents  other 
than  their  own.  Any  IAC  engaged  in  secondary  distribution  of  DoD  generated 
reports  snail  transfer  the  distribution  activity  to  the  DTIC. 

11.  The  DTIC  will  provide  microfiche  copies  of  technical  reports  originated 
by  the  IACs  to  DoD  and  its  contractors  registered  for  services  with  the  DTIC 

at  the  standard  microfiche  price. 

12.  Services  provided  by  the  IACs  will  be  on  a  cost-recovery  basis  in 
accordance  with  guidelines  provided  by  the  sponsoring  DoD  Component. 

B.  RESPONSIBILITIES 


1.  The  Sponsoring  DoD  Components  shall: 

a.  Establish  standard  reporting  requirements  and  performance 
measuring  criteria  for  each  IAC  under  its  cognizance  to  the  extent  possible 
to  permit  evaluation  of  the  relative  effectiveness  of  individual  IACs. 

b.  Ensure  that  the  IAC  has  a  clear  definition  of  subject  fields 
to  be  covered  to  avoid  duplication. 

c.  Evaluate  the  cost,  effectiveness,  and  continuing  need  for 
assigned  IACs. 

2.  The  Technical  Monitors  shall: 

a.  Establish  operational  procedures  consistent  with  DoD  security 
guidelines  and  technology  transfer  policy  for  IAC  services  to  Federal  agencies, 
the  private  sector,  and  other  customers. 

b.  Review  and  correct  as  necessary  IAC  publications  prior  to  printing 
and  dissemination. 

c.  Review,  in  conjunction  with  responsible  security  officials, 
IAC-origiaated  information  and  material  prior  to  public  release  to  ensure 
correct  distribution  statement  marking  in  accordance  with  DoD  Directive  5230.24 
(reference  (e))  and  to  ensure  correct  public  release  in  accordance  with  DoD 
Directive  5200.21  (reference  (f)). 

3.  The  IAC  shall: 

a.  Provide  services  to  the  DoD  departments,  agencies,  and  con¬ 
tractors  registered  for  services  with  the  DTIC. 

b.  Manage  and  control  information  and  data  elements  consistent  with 
the  requirements  of  DoD  Directive  50G0.19  (reference  (g))  and  .DoD  Directive 
5000.11  (reference  (h)). 
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c.  Report  oa  their  activities  consistent  with  the  Contract  Dat3 
Requirements  List  for  contractor-operated  LACs  and  with  report  requirements  of 
the  sponsoring  DoD  Component  for  DoD  in-house  operated  IACs.  DoD  Components 

of  the  National  Foreign  Intelligence  Program  involved  in  intelligence  collection, 
processing,  analysis,  production,  and  dissemination  functions  similar  to  those 
of  IACs  are  excluded  from  reporting  requirements  of  this  DoD  Regulation 
3200. 12-R-2. 

d.  Comply  with  directions  and  requirements  issued  by  the  sponsoring 
DoD  Component  and  the  Technical  Monitor. 


» 


» 


» 


► 


» 


» 
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LIST  OF  DOD  INFORMATION  ANALYSIS  CENTERS 
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APPENDIX  B: 

DOD  INFORMATION  ANALYSIS  CENTERS 

The  following  is  a  list  of  Information  Analysis  Centers  operated  by  or  on  behalf  of 
the  Department  of  Defense.  Those  Information  Analysis  Centers  funded  and/or  overseen 
by  the  Defense  Technical  Information  Center  are  highlighted  by  italicized  printing. 


CHEMICAL  WARFARE/CHEMICAL  COLD  REGIONS  SCIENCE  AND 


AND  BIOLOGICAL  DEFENSE 
INFORMATION  ANALYSIS 
CENTER  (CBIAC) 

Francis  T.  Crimmins,  Director 
Battelle  Edgewood  Operation 
CBIAC 

2113  Emmorton  Park  Road,  Suite  200 
Edgewood,  MD  21040 
(301)  676-9030/0200 
FAX:  (301)  676-9703 

COASTAL  ENGINEERING 
INFORMATION  ANALYSIS 
CENTER  (CEIAC) 

Dr.  Fred  E.  Camfield,  Director 
U.S.  Army  Engineer  Waterways 
Experiment  Station 
ATTN:  CEWES/CW-D 
3909  Halls  Ferry  Road 
Vicksburg,  MS  39180-6199 
(601)  634-2012 
FAX:  (601)  634-2055 

CHEMICAL  PROPULSION 

INFORMATION  AGENCY  (CPIA) 

Thomas  W.  Christian,  Director 

The  Johns  Hopkins  University 

Applied  Physics  Laboratory 

Chemical  Propulsion  Information  Agency 

Johns  Hopkins  Road 

Laurel,  MD  20723-6099 

(301)953-5850/5851 

(301)  992-7300 

FAX:  (301)  730-4969 


TECHNOLOGY  INFORMATION 
ANALYSIS  CENTER  (CRSTIAC) 
Nancy  Liston,  Librarian 
U.S.  Army  Cold  Regions  Research  and 
Engineering  Laboratory  (CRREL) 

72  Lyme  Road 
Hanover,  NH  03755-1290 
(603)  646-4221 
FAX:  (603)  646-4278 

CREW  SYSTEM  ERGONOMICS 
INFORMATION  ANALYSIS 
CENTER  (CSERIAC) 

Larry  Howell,  Director 
Dr.  Donald  Pozella,  Chief  Scientist 
Crew  System  Ergonomics  Information 
Analysis  Center 
AAMRL/HE/CSERIAC 
Wright-Patterson  AFB,  OH  45433-6573 
(513)  255-4842 
FAX:  (513)  255-4823 

DOD  CONCRETE  TECHNOLOGY 
INFORMATION  ANALYSIS 
CENTER  (CTIAC) 

Bryant  Mather,  Director 
U.S.  Army  Engineer  Waterways 
Experiment  Station 
ATTN:  CEWES/SV-Z 
3909  Halls  Ferry  Road 
Vicksburg,  MS  39180-6199 
(601)  634-3264 
FAX:  (601)  634-3242 
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DATA  AND  ANALYSIS  CENTER 
FOR  SOFTWARE  (DACS) 

John  Spina,  Program  Manager 
Kaman  Sciences  Corporation 
P.  O.  Box  120 
Utica,  NY  13503 
(315)  336-0937 
FAX:  (315)  732-3482 

DOD  NUCLEAR  INFORMATION 
AND  ANALYSIS  CENTER 
(DASIAC) 

Donald  Moffett,  Director 
Kaman  Sciences  Corporation 
2560  Huntington  Avenue,  Suite  500 
Alexandria,  VA  22303 
(703)  960-4774 
FAX:  (703)  329-7198 

TACTICAL  WEAPON  GUIDANCE 

AND  CONTROL  INFORMATION 

ANALYSIS  CENTER  (G  AC  I  AC) 

Dr.  Robert  Heaston,  Director 

IIT  Research  Institute 

10  West  35th  Street 

Chicago,  EL  60616 

(312)567-4519 

FAX:  (312)  567-4889 

HYDRAULIC  ENGINEERING 
INFORMATION  ANALYSIS 
CENTER  (HEIAC) 

RJ.  Brown,  Director 
Hydraulics  Laboratory 
U.S.  Army  Engineer  Waterways 
Experiment  Station 
ATTN:  CEWES/HV -Z 
3909  Halls  Ferry  Road 
Vicksburg,  MS  39180-6199 
(601)  634-2608 
FAX:  (601)634-2818 


HIGH  TEMPERATURE  MATERIALS 
INFORMATION  ANALYSIS 
CENTER  (HTMIAC) 

Dr.  Cho-Yen  Ho,  Director 
HTMIAC/CINDAS 
Purdue  University 
2595  Yeager  Road 
West  Lafayette,  IN  47906 
(317)494-9393 

FAX:  (317)  494-0811 

INFRARED  INFORMATION 
ANALYSIS  CENTER  (IRIA) 

Dr.  Joseph  Accetta,  Director 

Environmental  Research  Institute  of  Michigan 

P.O.  Box  8618 

Ann  Arbor,  MI  48107 

(313)  994-1200,  Ext.  2214 

FAX:  (313)994-5550 

MANUFACTURING  TECHNOLOGY 
INFORMATION  ANALYSIS 
CENTER  (MTIAC) 

Robert  Walk,  Director 

Ms.  Michal  Stevens,  Information  Specialist 

DT  Research  Institute 

lOWest  35th  Street 

Chicago,  1L  60616 

(312)  263-7125/609-9486 

FAX:  (312)781-6894 

METALS  AND  CERAMICS 

INFORMATION  CENTER  (MCIC) 

Harold  Mindlin,  Director 

Battelle  Memorial  Institute 

505  King  Avenue 

Columbus,  OH  43201-2693 

(614)  424-4425 

FAX:  (614)  424-3818 
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METAL  MATRIX  COMPOSITES 
INFORMATION  ANALYSIS 
CENTER  (MMCIAC) 

Mr.  William  McNamara,  Director 

Kaman  Sciences  Corporation 

816  State  Street 

P.0.  Box  Drawer  QQ 

Santa  Barbara,  CA  93102-1479 

(805)  963-6452 

FAX:  (805)  963-8420 

NONDESTRUCTIVE  TESTING 
INFORMATION  ANALYSIS 
CENTER  (NT  I  AC) 

Dr.  George  Matzkanin,  Director 
Texas  Research  Institute  Austin,  Inc 
415A  Crystal  Creek  Drive 
Austin,  TX  78746 
(512)  263-2106 
FAX:  (512)  263-3530 

PLASTICS  TECHNICAL 
EVALUATION  CENTER 
(PLASTEC) 

John  Nardone,  Director 
Plastics  Technical  Evaluation  Center 
Armament  Research  Development  and 
Engineering  Center  (ARDEC) 

Picatinny  Arsenal,  NJ  07806-5000 
(201)  724-4222 
FAX:  NONE 


RELIABILITY  ANALYSIS  CENTER 
(RAC) 

Steven  J.  Flint,  Technical  Director 
ITT  Research  Institute 
Rome  Air  Development  Center 
RAC 

Griffiss  AFB,  NY  13441-5700 
(315)  337-0900 
FAX:  (315)  337-9932 

SOIL  MECHANICS  INFORMATION 

AND  ANALYSIS  CENTER  (SMIAC) 

Joe  L.  Gatz,  Director 

U.S.  Army  Engineer  Waterways 

Experiment  Station 

ATTN:  CEWES/GV-Z 

3909  Halls  Ferry  Road 

Vicksburg,  MS  39180-6199 

(601)  634-3376 

FAX:  (601)  634-3139 

SURVIVABILITY/VULNERABILITY 
INFORMATION  ANALYSIS 
CENTER  (SURVIAC) 

John  M.  Vice,  Director 

Air  Force  Wright  Research  &  Development 

Center 

WRDC/FT/S/SURVIAC 
Wright-Patterson  AFB,  OH  45433-6553 
(513)  255-4840 
FAX:  (513)  255-9673 


PAVEMENTS  AND  SOIL  TACTICAL  TECHNOLOGY  CENTER 

TRAFFICABILITY  INFORMATION  (TACTEC) 

ANALYSIS  CENTER  (PSTIAC)  Larry  W.  Williams,  Director 

Gerald  W.  Tumage,  Director  Battelie  Memorial  Institute 

U.S.  Army  Engineer  Waterways  Experiment  505  King  Avenue 
Station  Columbus,  OH  43201-2693 

ATTN:  CEWES/GM-L  (614)  424-5047 

3909  Hails  Ferry  Road  FAX:  (614)  424-5263 

Vicksburg,  MS  39180-6199 
(601)  634-2734 
FAX:  (601)  634-3068 
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QUESTIONS  FOR  IAC  TECHNICAL  MONITORS 
AND  SPECIAL  TASK  USERS 

I.  DOD  REGULATION  3200.12-R-2  POLICIES  AND  PROCEDURES 

1 .  What  is  the  general  purpose  of  the  DoD  Information  Analysis  Center  Program? 

2 .  What  is  the  relationship  between  your  R&D  programs  and  IAC? 

3.  Is  your  IAC  functioning  in  a  major  "technology  thrust  area"  as  defined  or  described  in 
the  DoD  Directive? 

4.  Your  IAC  is  by  regulation  supposed  to  collect  information  from  as  many  sources  as 
possible  where  relevant  to  its  technical  area  of  expertise.  It  is  also  barred  by  regulation 
from  access  to  and  analysis  of  scientific  and  technical  intelligence. 

a.  Has  this  limitation  on  IAC  access  to  scientific  and  technical  intelligence  information 
interfered  with  the  performance  of  the  IAC  mission? 

b.  What  problems  has  the  limitation  on  access  to  scientific  and  technical  intelligence 
information  created  for  you  in  your  capacity  as  a  COTR? 

c.  What  problems  has  the  limitation  on  access  to  scientific  and  technical  intelligence 
information  created  for  you  in  your  capacity  as  a  DoD  Program  Manager? 

II.  BENEFITS  OF  THE  IAC  PROGRAM 

1 .  What  are  the  benefits  offered  by  your  IAC? 

2.  Focusing  first  on  operations  paid  for  by  core  funds,  what  are  thebenefits  (if  any)  that 
accrue  specifically  to  the  following  groups  or  individuals: 

a.  R&AT? 

b.  You,  as  COTR? 

c .  You,  in  your  other  DoD  capacities? 

d.  Other  IAC  contract  administrators? 

e.  DLA?  * 

f.  DTIC? 

g.  DESC? 

h.  DCAA/ACO? 

i.  Other  known  users  (specify  which  users)? 

j .  Users  currently  unknown  to  your  IAC  with  whom  you  interact? 
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3.  How  have  the  following  groups  or  individuals  benefited  from  activities  funded  as 
special  tasks: 

a.  R&AT? 

b.  You,  asCOTR? 

c .  You,  in  your  other  DoD  capacities? 

d.  Other  IAC  contract  managers? 

DLA? 

DTIC? 

DESC? 

DCAA/ACO? 

e.  Other  known  users  (specify)? 

f.  Users  currendy  unknown  to  NTIAC? 

4.  How  do  you  evaluate  the  benefits  of  IACs? 

a.  What  sorts  of  scales,  or  "metrics,"  do  you  use  to  measure  direct  benefits? 

b.  How  do  you  measure  the  indirect  benefits  of  IACs? 

c.  Is  the  process  for  measuring  the  direct  and  indirect  benefits  of  core  activities 
different  from  that  for  measuring  the  direct  and  indirect  benefits  of  special  tasks? 

5 .  Timing  in  benefit  measurement 

a.  When  do  die  benefits  of  your  IACs  use  accrue  to  the  user? 

b.  When  are  the  benefits  of  your  IACs  activities  measured? 

c.  What  impact  does  the  timi-g  of  benefit  measurement  have  on  the  results  of  the 
evaluation? 

III.  IAC  STRUCTURE 

1 .  From  your  perspective,  what  is  the  administration  and  management  structure  of  the 
DoD  IAC  Program  generally  and  the  administration  and  management  structure  for  the 
IAC(s)  with  which  you  are  most  familiar? 

3.  Can  you  describe  the  COTR's  role  in  the  administration  and  operation  of  an  IAC? 
a.  What  are  the  COTR's  responsibilities  in  each  of  the  following  areas: 

(1)  IAC  solicitation? 

(2)  Review  of  proposals? 

(3)  Award  of  contracts? 

(4)  Addition  of  special  tasks  to  contract? 

(5)  Review  and  evaluation  of  core  products  and  services  by  the  IAC?  By  core 
product  users? 
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(6)  Review  and  evaluation  of  special  task  by  the  IAC?  By  special  task  users? 

(7)  Review  of  IAC  performance  by  administrative  chain? 

(8)  Review  of  IAC  performance  by  policy  chain? 

4.  What  actions  do  you  take  to  promote  use  of  the  LACs  within  your  program?  What  do 
you  do  to  promote  use  by  DDDRE/R&AT?  Do  you  think  promotion  of  IAC  use  by 
other  DoD  programs  involved  in  research,  development,  operational  test  and 
evaluation  or  maintenance  is  also  part  of  your  job? 

5.  What  do  you  do  to  promote  inter-IAC  communications? 

6.  Can  you  describe  the  function  of  the  DoD  program  manager  with  respect  to  the  LACs 
in  general  and  NTIAC  in  particular? 

a.  Under  what  conditions  does  your  dual  role  benefit  you? 

b.  Under  what  conditions  does  your  dual  role  benefit  the  IAC? 

7.  What  is  the  function  of  DESC  with  respect  to  the  IAC? 

8.  What  is  your  working  relationship  with  your  contracting  officer? 

9 .  What  is  DTIC s  interaction/mvol vement  wi  th  NTIAC? 

10.  What  is  the  DCAS's  irteraction/involvement  with  NTIAC? 

1 1 .  What  is  the  function  of  DLA(HQ)  with  respect  to  the  IAC? 

a.  Under  what  circumstances  do  you  communicate  directly  with  DLA(HQ)? 
Would  your  IAC  always  inform  you  of  its  communications  with  DLA(HQ)? 

b.  How  is  DLA(HQ)  involved  with  [IAC]'s  core  projects  and  special  tasks? 

12.  What  is  the  function  of  DDDR&EIR&AT! 

a.  Is  that  office  ever  in  direct  communication  with  your  IAC? 

b.  How  is  OUSD(A)(R&AT)  involved  with  your  LAC’s  core  projects  and  special 
tasks? 

13.  How  much  of  your  working  time  do  you  typically  spend  working  on  or  with  your  IAC 
during  the  course  of  a  month? 

a.  Of  the  time  allotted  to  IAC  activities,  how  much  is  generally  spent  dealing  with 
operational  issues?  Contract  administration  issues?  And  policy  issues? 

b.  How  much  of  your  time  involves  dealing  with  core  activities?  Special  tasks? 

IV.  COSTS  IN  THE  IAC  PROGRAM 

1 .  What  are  the  costs  of  the  IAC  program? 

2.  What  are  the  burdens  on  your  IAC  and  on  the  government  imposed  by  the  LACs 
interaction  with  each  of  the  following: 


a.  DDDR&E/R&AT? 

b.  DLA(HQ)? 

c.  DTIC? 

d.  DCAS? 

e.  DESC? 

3 .  Can  you  place  a  dollar  cost  on  these  burdens? 

4.  Are  there  specific  burdens  or  indirect  costs  imposed  on  your  LAC  by  DCAS,  DESC,  or 
DLA  which  make  your  IAC  a  less  attractive  source  of  research,  analys;\  and 
assistance  to  current  or  potential  users  than  other  contractors  or  government  activities? 

5.  If  you  were  to  perform  cost-benefit  analysis  of  the  IAC  program  and  were  to  analyze 
the  costs  of  the  program  to  each  entity  involved  with  the  administration,  or  policy 
planning  for.  or  operation  of  the  IAC,  what  would  you  have  to  say  about  the  costs  of 
the  program  to  each  of  the  following  offices: 

a.  DDDR&E/R&AT? 

b.  DLA(HQ)? 

c.  DTIC? 

d.  DCAS? 

e.  DESC? 

6.  What  opportunity  costs  are  associated  with  the  IAC  program?  Could  funds  currently 
allotted  to  your  IAC  be  as  effectively  utilized  by  others  in  the  R&D/Defense  industry 
community  to  solve  similar  problems? 

7.  What  are  the  positive  and  negative  impacts  of  the  performance  of  special  tasks  for  the 
conduct  of  core  tasks? 

V.  PROGRAM  OPERATIONS 

1 .  How  does  the  physical  location  of  an  IAC  affect  the  operation  of  that  IAC? 

a.  What  are  the  advantages  of  collocating  an  IAC  with  its  COTR?  What  are  the 
disadvantages? 

b.  What  are  the  advantages  of  collocating  an  IAC  with  its  user  base?  Are  there 
disadvantages?  Are  the  advantages  and  disadvantages  different  for  core  and 
special  tasks? 

2.  IAC  Evaluations 

a.  When,  if  ever,  does  each  of  the  following  offices  conduct  program  evaluations: 
COTR 

DDDR&E/R&AT 


DCAS 

DESC 


b.  What  steps  have  you  taken  to  ensure  that  your  IAC  undertakes  ongoing  evaluation 
of  its  operations  and  products? 

c.  Describe  each  type  of  evaluation.  How  useful  is  each  to  you?  To  the  IAC?  To  the 
evaluator? 

3 .  Can  you  briefly  describe  DIA  's  contract  administration  of  the  IAC  contract? 

4.  Can  you  briefly  describe  the  government’s  accounting  system  for  your  IAC’s 
expenditures? 

a.  Is  the  system  useful  and  relevant  to  you?  What  function  does  it  serve  for  you? 
For  DDDR&E/R&AT?  For  DLA? 

b.  What  are  the  burdens  imposed  by  the  accounting  system?  What  is  its  impact  on  the 
user  base? 
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5.  Can  you  inform  us  how  the  following  individuals  or  groups  facilitate  or  impede  the 
performance  of  [LAC]'s  studies,  analyses,  and  activities  in  support  of  the  Defense 
Department? 


Group  or  individual 


Facilitate 


Impede 


Program  Manager 

COTR 

DESC 

ACO 

OTIC 

DLA(HQ) 

OUSD(A)(R&AT) 

Special  task  users 

Core  task  users 

Other  DoD  Agencies 
(e.g.,  DTSA) 


VI.  RECOMMENDATIONS 

1 .  What  changes  would  you  make  in  each  cf  the  following  areas: 

a.  IAC  goals  and  objectives? 

b.  Policy  guidance  with  respect  to  IAC  operations? 

c.  Accounting  cf  IAC  benefits? 

d.  Management  structure? 

e.  Policy  guidance 

f.  Accou  nting  procedures? 
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CBIAC  CORE  USER  INFORMTION 


PRODUCT  HAKE 

USER 

QUANTIFIES 

BENEFITS 

BENEFIT  LM8UMTIFIEI 

BENEFITS 

DESCRIPTION  OF  BENEFIT/DISCUSSION 

Oocueent 

Battel  It,  Coluaous,  OH 

0 

Asked  for  docueent  for  n»r  boss.  Does  not 
knot  unit  nt  did  eitb  it. 

Bibliographies 

Battetlf,  Edoewoo 

Operations,  Pdcenswd.  If 

0 

Used  in  research.  If  «e«t  to  the  library, 
nould  ultiaately  m no  up  costmp  sponsor 
■oney  for  tide  spent  researching 
inforoation. 

bibhoor  aptly 

Battell e-uavton 

Ooerationi,  Dayton,  OH 

0 

used  inrcreation  ror  an  Air  Force 
procuretent  plan  tor  re»ote  sensors. 
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lal  oroyrat  u  oroyrm.  tool  otr  far 
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ttCIJC  il  intaaaotoot  ant  »«  "ooraraamt 
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APPENDIX  F: 


INDIVIDUAL  RESPONSE  BENEFITS  FROM  RAC 


APfEROII  F 

kK  CORE  USED  INFORMTIOi 


fflOOUCT  HARE 

usa 

QUAATIFIEJ 

BENEFITS 

9EXEF1T 

TYPE 

UMUAITIFIE9 

BENEFITS 

3ESCRIPTIW  OF  iENCFIT/MSCUSSIM 

Docuiontt 

Sittril  Irmutics-Conriir 
Oimico.  U»  Aim.  CA 

9 

libririu.  Btlitvtt  tlut  scmtists  and 
niiutn  uu  thn  it  ro(*r»«c«  dKoomts. 

iiKUMoti  in,  cintM,  w 


flrttrtnco  tittrul  only. 


Hocuunts  NASA,  Am  Smirch 

Ctntir,  Motfitt  Fills,  CA 


0 


Inyolrtd  in  stitr-of-thmrt  rmircn  ind 
■ost  inforution  out  at  dltl  (or  his 
psrfgns, 


QocuMflts  Rmditch.  Fishn-s,  Nt 


0 


Us*  for  rtiirmct;  only  toorc*  miUblt. 


Dociuotts  SAM  Aurici,  Hrrnm,  v* 


9 


Parching  Adtuistritor,  Aon  not  knoo  «tnt 
tho  tKtiicil  pioylt  in  Swdtt  do  »ith  tho 
docomts,  dot  forurdt  thtt  to  5aod«. 


Oxumts  Unim.  Full,  PA 


®  Libririu.  Enqinnrs  uu  doc  amts  for 

rrttrnct.  At  librarus,  bilimt  it  it  ooro 
.  eott  fFFKtivo  to  90  to  RAC  (or  inforoition 

~  ..  thw  oultiplf  sour  cm. 
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lon|ir.  Ualtkilr  t»  oontroto  infortatio# 
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Coatmi  Mffw  Hills. 

« 
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i*r**4  W) 
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MUTCH  ailllull. 
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ai  roforncto.  Hu,  liU 
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Hilt,  loiloro  rati  Utl  anil  Mat  to  nut 
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u 
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3o«|Ot  itHtwuwit  aorifkttiaa  lor  dint 
tut  rHitMJnt  not «co  nal-’t  to  Un  rouiino 

MiiuuKi  t*  rnwo  wiiin  :m  a.*iO 
un  M  ta  (a  !i  S..’..  iSyitom  ftoiitaility 
Small  for  uulor  urt  il  rJC  no  not 


nut.  loo  •  n.mt  tor:  tot 

ittlno  uuitrr  irnol  n*«m  Ut  ncm 
of  I  KB c>  It  ut  U.S). 


nm»n  f 

uc  csn  usw  ltfwvria 


moucr  nut  m  usa 


WMTIFID  1061!  UMWSIIFIO  0E5CMHIM  Of  BEWEFIT/DlSCUSSIffit 

806ITS  ITfl  KiifITS 


Iramina  Cwm,  faallo  Conauttrt, 

Oocumti  Cititttari.  M 


OKIMtltl 


Eantat  (Mil.  focntttir. 

tf 


1,3  Mitw»  aarrintm 


1.3  Jatifi  clatott 


Hu  toat  intral  of  Hit  nqimn  for 
trainin'  i»  «wi?t  raluiility,  Only 
iiforaatian  t«rc*  lootin'  *t  largo 
potalitiot  orw  tiu.  Intonation  arifl  to 
dauatu'  protottu  >1111  fulcra  rates  sa.1 
•arruty  latat.  To  collect  itfcreatira  Ins 
RAC  sa  t!M  connotin'  raiida't  Sctn*r . 

Know  at  jo  ot.nir  toorct  ins  Mat.  Used 
intonation  proridsd  for  praoictioni  on 
product  rtliaoility.  Infcrtation  illo-c-l 
coat'd  it  ton  cotootettt  and  letign  of 
pradaett. 


itennical  inautry,  £51.  oaanrait.  CO 
Docuatntt 

prewti  fuilicatino  intonation  in  tne  lib 

(tiptntivai. 
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jarta  a  lot  of  tonty 


Him  inf  or  tattoo  in  rinaoilitr  prediction. 
Uncut  of  no  otntr  loom  tetceot  5-00.  Snta 


Qxusaatt  Hoterdll.  Photnn,  t! 


1,3  Rata  tort  miir  Utt  Mt  detoamtt  witly  in  rtliuility 

aiilnet  ana  preOlctiont.  loforiatitn 
proniea  tan  it  tatnr  to  otriort  itcditt. 
tould  not  )•  a«li  to  'derate  oata  for 
iiiitalf. 


CMtutvr  T««oi4t«. 
94C«M*t9 

Hartlt  Rarutta.  5r lanaa. 

sfl 

1.) 

S*tH  HNTi 

Iiiferutioo  fro«  MC  e»wuwt  so  (toe*  n c 
Dm  to  ooaitor  hterititrt.  ofliftij  to  otH-i 
wen  iort  tifficilt  M4  tm  cmiuoir.g. 
Otntr  co*ui*r*4it  iwrcw  coit  tevMt  & 
tnplf  S&C.  i«4orwt;c«  in  $*1311-2. 

on  itcri^fi  4  mfiimal  dit#  in  f 
docs*mt.  S**ttittrt  tro«  WC  ib  dnuja 

See  mod 

Raytnaot,  fortxsttt,  II 

1,3 

UdfMN  uforwtic* 

Uwi  for  full  ijitorin  tf  iicroctrc'.nts, 
f ill  art  iMlvsiit  ?.f»  i  intt*  *em  IB  4 
qi»*4  lAvirtnawit,  'rftlpi  otttrttri  o»th 
P4f tf  BWt  IflOltlWdi  U8  iillvft  IW|>SIS 
Coal 4  b«  so  otstr  RAC 
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kUMtl, 

ciiiMcrm  Some** 

ftsetMil  laiWMtiMui, 

CHV  R*|US,  IA 

i.: 

u*H  tm,  uumr 

lists  MC  far  docuaeats  uid  u  ska  •oris  tore 
rfficefltly.  fectus*  RAC  urwM  tlectrcsiC 
parts*  anas  ion*  t  nm  to  do  intruilr, 
saving  Htty.  aanooaer •  fti  wsj id  not  St  able 
to  gtoerat*  broad  tacuga  lit*  oast  m-nous*.  , 

Q0CUM*tS 

G'teili  Asioc.,  Cat  tea,  OH 

!,» 

Mis  cowan*  is  a  Mall  bmintsi  p*r»or»ing 
logistic  analysts.  Has  5*tn  contracts  to 
porfort  reliability  predictions  and  failure 
aode  analysts  for  JOl-iWf  ill  surveillance 
svfteot  V-22  Qsereyi  and  a  jrtlauacn  syste*. 

H#  coild  not  coaoett  or  awt  contract 
rtoiirmets  for  cn*  predictions  *itnout 
acctss  to  RAC  data  oaso. 

fiilur#  fiat* 
IntorMtiort 

fiavtnwfl,  Sutaurv,  rut 

1,7 

m>m  mn  i»  lit  Ins 

Mewed  SCA  inrortatuit  cn  s«»conductors. 
IftforNtioo  oroviQM  saved  nit  navinq  to 
psrtors  costly  laa  *cr»,  ana  ns  oid  not  nave 
to  do  statistical  analysts.  Cost  of  doing 
■ore  Biistlf  sroftioitive  ant  *cuid  have  flirt 
to  as«  relief  froo  ratar  failure  rat*  ' 

rw*ire***t,  Ports  on  A£3IS,  TARTAR, 

PATRIOT,  and  »i*c»llaneeus  rAA  contracts. 

ftchmcai  laouirm 

moor  Root,  Hartford,  CT 

1.7 

W«t«  sulits  iitvuici 

Used  RAC  for  'inability  predictions  and 
analysts  and  to  stt  ua  in -nous*  reliability 
caoalliitv.  Intonation  uses  tr»  sating  design 
cflinm  for  greater  rthaoiiity.  titn 
iimhii  caoaoihtv  tav  3«  list  ttomsivt  to 
attack  rthaoiiity  nwn,  dot  lack  tit 
library  and  database  RAC  hat. 

Ik  finical  [nauiry, 
Ooouwnts 

Digital  bip*»t. 

Maynard,  n A 

:.J 

Otintmts.  wirt  tcmrf 

lis*d  RAC  to  stttlf  difference  of  ooinics  at 
Oiqital.  Mas  gone  for  intonation  w 
activatioo  energies  at  ICt.  Could  collect  the 
itforMtioa  ftiaidif  at  a  significantly  hiqfttr 
cost  ttsotciailt  failure  r*t*  inforwtio*). 
fatting  data  wield  tat*  period  tf  years  .'nd 

IS  very  ei pensive. 

Oat*  tut, 

Publication* 

Prodact  Hvjtuki 

Directorate,  Nitant 

Atm**!,  ft. 

5 

Mint  cititilitln 

fall  awre  of  RAC’s  CMioilities,  but  d*«  to 
fsfaiM  hiitations,  cannot  as#  j  lot  of 
thtir  struct*.  fall  eves  hit  cioaithtm 
•wild  fa  better  if  h*  na«  funds  to  us*  SAC'* 
special  services,  Currently  RAC  infortauod 
lifts  to  rtfin*  ms  analysis. 
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JOEFIT 

rat 
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sOEFITS 


3OTIPTIC*  Of  SOEflT/llISflJSSIM 
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Ox'u*flts 


Coitti,  fairfai,  7ft 


3«»m(s 


teamMii,  E4lM«  flft 


*•/ 


ourror  soa* 


librarian,  3th«««<  Wfinwri  uit  flocuwm 
it  jro9<ml  grtfirtuot  *<art  for  tht 
rtlialllity/uutruaci  Mtrn  zi  tfi» 
profoul. 


'Jm  at  a  rtf  true*  aort  for  itu<in« 
prototait.  Iniircctly  atlimt  tnfortatiot 
frot  iK  o*  failurt  ratti,  faiiurt  MCftMiitt 
Mr  ftavt  H44  «A  lM4Ct  ON  tfht  30~torprto 
protru  m  tfi#  CD  mtN  for  tftt  Air  Foret. 
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